[liblouis-liblouisxml] Re: Why is there an error in this test run?
- From: Bert Frees <bertfrees@xxxxxxxxx>
- To: liblouis-liblouisxml@xxxxxxxxxxxxx
- Date: Fri, 06 Jun 2014 17:07:12 +0200
Hi Keith,
Most of the expected failures are bugs. When I encounter a bug I add it
as a test in order to not forget about it. The other failure is new to me.
Keith Creasy writes:
> John, I did run the liblouisutdml tests:
>
> Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0
>
> FAIL: run_test_suite.sh
> =============================================
> 1 of 3 tests failed
> Please report to john.boyer@xxxxxxxxxxxxxxxxx
>
>
> Why does it expect 7 failures?
>
>
> Here is the entire output:
>
> Making check in gnulib
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make check-recursive
> make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[3]: Nothing to be done for `check-am'.
> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> Making check in doc
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/doc'
> make[1]: Nothing to be done for `check'.
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/doc'
> Making check in lbu_files
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/lbu_files'
> make[1]: Nothing to be done for `check'.
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/lbu_files'
> Making check in liblouisutdml
> make[1]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
> make[1]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
> Making check in tests
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> Making check in test_suite
> make[2]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> Making check in test_01
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
> Making check in test_02
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
> Making check in test_03
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
> Making check in test_04
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
> Making check in test_05
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
> Making check in test_06
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
> Making check in test_07
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
> Making check in test_08
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
> Making check in test_09
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
> Making check in test_10
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
> Making check in test_11
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
> Making check in test_12
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
> Making check in test_13
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
> make[3]: Entering directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> make[3]: Nothing to be done for `check-am'.
> make[3]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> make[2]: Leaving directory
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make testTranslateString tripleTrans \
> run_test_suite.sh
> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make[3]: `testTranslateString' is up to date.
> make[3]: `tripleTrans' is up to date.
> make[3]: Nothing to be done for `run_test_suite.sh'.
> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make check-TESTS
> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> XFAIL: testTranslateString
> PASS: tripleTrans
> --------------------------------------------------------------------------------
> TESTS
> --------------------------------------------------------------------------------
> Running test_01...
> Testing pagenum, runninghead and footer semantic actions
> \033[1m\033[91mFAIL\033[0m\033[0m
> Running test_02...
> Testing footer when some text immediately precedes the footer element
> \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_03...
> footer bug
> \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_04...
> Testing prehyphenation
> \033[1m\033[92mPASS\033[0m\033[0m
> Running test_05...
> Testing printPageNumberRange option with printPageNumberAt=bottom
> \033[1m\033[92mPASS\033[0m\033[0m
> Running test_06...
> Testing printPageNumberRange option with printPageNumberAt=top
> \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_07...
> Testing orphanControl
> \033[1m\033[92mPASS\033[0m\033[0m
> Running test_08...
> Testing nested orphanControl. Outer orphanControl assertion should not be
> dropped when inner orphanControl is encountered.
> \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_09...
> Testing hyphenation
> \033[1m\033[92mPASS\033[0m\033[0m
> Running test_10...
> Testing negative firstLineIndent
> \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_11...
> Testing braille page numbering table (pageNumberTable)
> \033[1m\033[92mPASS\033[0m\033[0m
> Running test_12...
> Testing whitespace-only text-node in mixed content.
> \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_13...
> Testing printPageNumberRange when a page break in print happens right
> before
> a page break in braille (fails when printPageNumberAt=bottom)
> \033[1m\033[93mXFAIL\033[0m\033[0m
>
> Summary:
> --------
> Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0
>
> FAIL: run_test_suite.sh
> =============================================
> 1 of 3 tests failed
> Please report to john.boyer@xxxxxxxxxxxxxxxxx
> =============================================
> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> Keith
>
>
> -----Original Message-----
> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx
> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of John J. Boyer
> Sent: Friday, June 06, 2014 5:30 AM
> To: liblouis-liblouisxml@xxxxxxxxxxxxx
> Subject: [liblouis-liblouisxml] Re: Why is there an error in this test run?
>
> Bert,
>
> Thanks. We'll be adding some tests to check UTDML .
>
> John
>
> On Fri, Jun 06, 2014 at 11:13:32AM +0200, Bert Frees wrote:
>> Keith and John,
>>
>> There was a bug in the script indeed when run by itself and not
>> through `make check`. I fixed that bug now, but it doesn't matter
>> really. The script is supposed to be run with make check anyway
>> because make takes care of setting LD_LIBRARY_PATH etc.
>>
>> You may also consider setting the `colors` var in the script to false.
>> It is merely a visual help for myself, but I noticed from your emails
>> that it produces garbage in your shell.
>>
>> Thanks,
>> Bert
>>
>>
>> Bert Frees writes:
>>
>> > This used to work. Haven't used it for a while. Let me check what's wrong.
>> >
>> > Bert
>> >
>> > Keith Creasy writes:
>> >
>> >> Yes, this is what I found also. Thanks.
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx
>> >> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of
>> >> John J. Boyer
>> >> Sent: Thursday, June 05, 2014 10:56 AM
>> >> To: liblouis-liblouisxml@xxxxxxxxxxxxx
>> >> Subject: [liblouis-liblouisxml] Why is there an error in this test run?
>> >>
>> >> Below is a typescript of running the tests in liblouisutdml. There seems
>> >> to be a problem in finding things.
>> >>
>> >> Script started on Thu 05 Jun 2014 09:48:57 AM CDT
>> >> $31:3>./run_test_suite.sh
>> >> -------------------------------------------------------------------
>> >> -------------
>> >> TESTS
>> >> -------------------------------------------------------------------
>> >> -------------
>> >> ./run_test_suite.sh: 49: cd: can't cd to /test_suite/test_* Running
>> >> test_*...
>> >> Can't find configuration file 'styles.cfg'
>> >> Can't open input file input.xml.
>> >>
>> >> [1m[91mERROR[0m[0m
>> >>
>> >> Summary:
>> >> --------
>> >> Tests run: 1, Failures: 0, Expected failures: 0, Errors: 1
>> >>
>> >> $31:3>exit
>> >> exit
>> >>
>> >> Script done on Thu 05 Jun 2014 09:49:48 AM CDT
>> >>
>> >> John
>> For a description of the software, to download it and links to project
>> pages go to http://www.abilitiessoft.com
>
> --
> John J. Boyer; President, Chief Software Developer Abilitiessoft, Inc.
> http://www.abilitiessoft.com
> Madison, Wisconsin USA
> Developing software for people with disabilities
>
> For a description of the software, to download it and links to project pages
> go to http://www.abilitiessoft.com
> For a description of the software, to download it and links to
> project pages go to http://www.abilitiessoft.com
For a description of the software, to download it and links to
project pages go to http://www.abilitiessoft.com
Other related posts:
