[liblouis-liblouisxml] Re: Why is there an error in this test run?

  • From: Keith Creasy <kcreasy@xxxxxxx>
  • To: "liblouis-liblouisxml@xxxxxxxxxxxxx" <liblouis-liblouisxml@xxxxxxxxxxxxx>
  • Date: Fri, 6 Jun 2014 14:57:08 +0000

John, I did run the liblouisutdml tests:

Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0

FAIL: run_test_suite.sh
=============================================
1 of 3 tests failed
Please report to john.boyer@xxxxxxxxxxxxxxxxx


Why does it expect 7 failures?


Here is the entire output:

Making check in gnulib
make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
make  check-recursive
make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
make[3]: Nothing to be done for `check-am'.
make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
Making check in doc
make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/doc'
make[1]: Nothing to be done for `check'.
make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/doc'
Making check in lbu_files
make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/lbu_files'
make[1]: Nothing to be done for `check'.
make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/lbu_files'
Making check in liblouisutdml
make[1]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
Making check in tests
make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
Making check in test_suite
make[2]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
Making check in test_01
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
Making check in test_02
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
Making check in test_03
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
Making check in test_04
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
Making check in test_05
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
Making check in test_06
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
Making check in test_07
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
Making check in test_08
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
Making check in test_09
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
Making check in test_10
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
Making check in test_11
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
Making check in test_12
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
Making check in test_13
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
make[3]: Nothing to be done for `check'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
make[3]: Entering directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
make[3]: Nothing to be done for `check-am'.
make[3]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
make[2]: Leaving directory 
`/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
make  testTranslateString tripleTrans \
          run_test_suite.sh
make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
make[3]: `testTranslateString' is up to date.
make[3]: `tripleTrans' is up to date.
make[3]: Nothing to be done for `run_test_suite.sh'.
make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
make  check-TESTS
make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
XFAIL: testTranslateString
PASS: tripleTrans
--------------------------------------------------------------------------------
TESTS
--------------------------------------------------------------------------------
Running test_01...
   Testing pagenum, runninghead and footer semantic actions
   \033[1m\033[91mFAIL\033[0m\033[0m
Running test_02...
   Testing footer when some text immediately precedes the footer element
   \033[1m\033[93mXFAIL\033[0m\033[0m
Running test_03...
   footer bug
   \033[1m\033[93mXFAIL\033[0m\033[0m
Running test_04...
   Testing prehyphenation
   \033[1m\033[92mPASS\033[0m\033[0m
Running test_05...
   Testing printPageNumberRange option with printPageNumberAt=bottom
   \033[1m\033[92mPASS\033[0m\033[0m
Running test_06...
   Testing printPageNumberRange option with printPageNumberAt=top
   \033[1m\033[93mXFAIL\033[0m\033[0m
Running test_07...
   Testing orphanControl
   \033[1m\033[92mPASS\033[0m\033[0m
Running test_08...
   Testing nested orphanControl. Outer orphanControl assertion should not be 
   dropped when inner orphanControl is encountered.
   \033[1m\033[93mXFAIL\033[0m\033[0m
Running test_09...
   Testing hyphenation
   \033[1m\033[92mPASS\033[0m\033[0m
Running test_10...
   Testing negative firstLineIndent
   \033[1m\033[93mXFAIL\033[0m\033[0m
Running test_11...
   Testing braille page numbering table (pageNumberTable)
   \033[1m\033[92mPASS\033[0m\033[0m
Running test_12...
   Testing whitespace-only text-node in mixed content.
   \033[1m\033[93mXFAIL\033[0m\033[0m
Running test_13...
   Testing printPageNumberRange when a page break in print happens right before 
   a page break in braille (fails when printPageNumberAt=bottom)
   \033[1m\033[93mXFAIL\033[0m\033[0m

Summary:
--------
Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0

FAIL: run_test_suite.sh
=============================================
1 of 3 tests failed
Please report to john.boyer@xxxxxxxxxxxxxxxxx
=============================================
make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
Keith


-----Original Message-----
From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx 
[mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of John J. Boyer
Sent: Friday, June 06, 2014 5:30 AM
To: liblouis-liblouisxml@xxxxxxxxxxxxx
Subject: [liblouis-liblouisxml] Re: Why is there an error in this test run?

Bert,

Thanks. We'll be adding some tests to check UTDML .

John

On Fri, Jun 06, 2014 at 11:13:32AM +0200, Bert Frees wrote:
> Keith and John,
> 
> There was a bug in the script indeed when run by itself and not 
> through `make check`. I fixed that bug now, but it doesn't matter 
> really. The script is supposed to be run with make check anyway 
> because make takes care of setting LD_LIBRARY_PATH etc.
> 
> You may also consider setting the `colors` var in the script to false. 
> It is merely a visual help for myself, but I noticed from your emails 
> that it produces garbage in your shell.
> 
> Thanks,
> Bert
> 
> 
> Bert Frees writes:
> 
> > This used to work. Haven't used it for a while. Let me check what's wrong.
> >
> > Bert
> >
> > Keith Creasy writes:
> >
> >> Yes, this is what I found also. Thanks.
> >>
> >>
> >> -----Original Message-----
> >> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx 
> >> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of 
> >> John J. Boyer
> >> Sent: Thursday, June 05, 2014 10:56 AM
> >> To: liblouis-liblouisxml@xxxxxxxxxxxxx
> >> Subject: [liblouis-liblouisxml] Why is there an error in this test run?
> >>
> >> Below is a typescript of running the tests in liblouisutdml. There seems 
> >> to be a problem in finding things.
> >>
> >> Script started on Thu 05 Jun 2014 09:48:57 AM CDT 
> >> $31:3>./run_test_suite.sh
> >> -------------------------------------------------------------------
> >> -------------
> >> TESTS
> >> -------------------------------------------------------------------
> >> -------------
> >> ./run_test_suite.sh: 49: cd: can't cd to /test_suite/test_* Running 
> >> test_*...
> >> Can't find configuration file 'styles.cfg'
> >> Can't open input file input.xml.
> >>
> >>    [1m[91mERROR[0m[0m
> >>
> >> Summary:
> >> --------
> >> Tests run: 1, Failures: 0, Expected failures: 0, Errors: 1
> >>
> >> $31:3>exit
> >> exit
> >>
> >> Script done on Thu 05 Jun 2014 09:49:48 AM CDT
> >>
> >> John
> For a description of the software, to download it and links to project 
> pages go to http://www.abilitiessoft.com

--
John J. Boyer; President, Chief Software Developer Abilitiessoft, Inc.
http://www.abilitiessoft.com
Madison, Wisconsin USA
Developing software for people with disabilities

For a description of the software, to download it and links to project pages go 
to http://www.abilitiessoft.com
For a description of the software, to download it and links to
project pages go to http://www.abilitiessoft.com

Other related posts: