[liblouis-liblouisxml] Re: Why is there an error in this test run?

  • From: "John J. Boyer" <john.boyer@xxxxxxxxxxxxxxxxx>
  • To: liblouis-liblouisxml@xxxxxxxxxxxxx
  • Date: Fri, 6 Jun 2014 10:13:04 -0500

Keith,

This looks good as far as the output of the test run is concerned. I 
don't know why failures are expected. It's something for Bert to 
explain. Shouldn't he be the one to receive bug reports? I'm no longer 
the appropriate person.

John

On Fri, Jun 06, 2014 at 02:57:08PM +0000, Keith Creasy wrote:
> John, I did run the liblouisutdml tests:
> 
> Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0
> 
> FAIL: run_test_suite.sh
> =============================================
> 1 of 3 tests failed
> Please report to john.boyer@xxxxxxxxxxxxxxxxx
> 
> 
> Why does it expect 7 failures?
> 
> 
> Here is the entire output:
> 
> Making check in gnulib
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make  check-recursive
> make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[3]: Nothing to be done for `check-am'.
> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> Making check in doc
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/doc'
> make[1]: Nothing to be done for `check'.
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/doc'
> Making check in lbu_files
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/lbu_files'
> make[1]: Nothing to be done for `check'.
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/lbu_files'
> Making check in liblouisutdml
> make[1]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
> make[1]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
> Making check in tests
> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> Making check in test_suite
> make[2]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> Making check in test_01
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
> Making check in test_02
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
> Making check in test_03
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
> Making check in test_04
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
> Making check in test_05
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
> Making check in test_06
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
> Making check in test_07
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
> Making check in test_08
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
> Making check in test_09
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
> Making check in test_10
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
> Making check in test_11
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
> Making check in test_12
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
> Making check in test_13
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
> make[3]: Nothing to be done for `check'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
> make[3]: Entering directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> make[3]: Nothing to be done for `check-am'.
> make[3]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> make[2]: Leaving directory 
> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make  testTranslateString tripleTrans \
>         run_test_suite.sh
> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make[3]: `testTranslateString' is up to date.
> make[3]: `tripleTrans' is up to date.
> make[3]: Nothing to be done for `run_test_suite.sh'.
> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make  check-TESTS
> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> XFAIL: testTranslateString
> PASS: tripleTrans
> --------------------------------------------------------------------------------
> TESTS
> --------------------------------------------------------------------------------
> Running test_01...
>    Testing pagenum, runninghead and footer semantic actions
>    \033[1m\033[91mFAIL\033[0m\033[0m
> Running test_02...
>    Testing footer when some text immediately precedes the footer element
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_03...
>    footer bug
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_04...
>    Testing prehyphenation
>    \033[1m\033[92mPASS\033[0m\033[0m
> Running test_05...
>    Testing printPageNumberRange option with printPageNumberAt=bottom
>    \033[1m\033[92mPASS\033[0m\033[0m
> Running test_06...
>    Testing printPageNumberRange option with printPageNumberAt=top
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_07...
>    Testing orphanControl
>    \033[1m\033[92mPASS\033[0m\033[0m
> Running test_08...
>    Testing nested orphanControl. Outer orphanControl assertion should not be 
>    dropped when inner orphanControl is encountered.
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_09...
>    Testing hyphenation
>    \033[1m\033[92mPASS\033[0m\033[0m
> Running test_10...
>    Testing negative firstLineIndent
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_11...
>    Testing braille page numbering table (pageNumberTable)
>    \033[1m\033[92mPASS\033[0m\033[0m
> Running test_12...
>    Testing whitespace-only text-node in mixed content.
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> Running test_13...
>    Testing printPageNumberRange when a page break in print happens right 
> before 
>    a page break in braille (fails when printPageNumberAt=bottom)
>    \033[1m\033[93mXFAIL\033[0m\033[0m
> 
> Summary:
> --------
> Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0
> 
> FAIL: run_test_suite.sh
> =============================================
> 1 of 3 tests failed
> Please report to john.boyer@xxxxxxxxxxxxxxxxx
> =============================================
> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> Keith
> 
> 
> -----Original Message-----
> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx 
> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of John J. Boyer
> Sent: Friday, June 06, 2014 5:30 AM
> To: liblouis-liblouisxml@xxxxxxxxxxxxx
> Subject: [liblouis-liblouisxml] Re: Why is there an error in this test run?
> 
> Bert,
> 
> Thanks. We'll be adding some tests to check UTDML .
> 
> John
> 
> On Fri, Jun 06, 2014 at 11:13:32AM +0200, Bert Frees wrote:
> > Keith and John,
> > 
> > There was a bug in the script indeed when run by itself and not 
> > through `make check`. I fixed that bug now, but it doesn't matter 
> > really. The script is supposed to be run with make check anyway 
> > because make takes care of setting LD_LIBRARY_PATH etc.
> > 
> > You may also consider setting the `colors` var in the script to false. 
> > It is merely a visual help for myself, but I noticed from your emails 
> > that it produces garbage in your shell.
> > 
> > Thanks,
> > Bert
> > 
> > 
> > Bert Frees writes:
> > 
> > > This used to work. Haven't used it for a while. Let me check what's wrong.
> > >
> > > Bert
> > >
> > > Keith Creasy writes:
> > >
> > >> Yes, this is what I found also. Thanks.
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx 
> > >> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of 
> > >> John J. Boyer
> > >> Sent: Thursday, June 05, 2014 10:56 AM
> > >> To: liblouis-liblouisxml@xxxxxxxxxxxxx
> > >> Subject: [liblouis-liblouisxml] Why is there an error in this test run?
> > >>
> > >> Below is a typescript of running the tests in liblouisutdml. There seems 
> > >> to be a problem in finding things.
> > >>
> > >> Script started on Thu 05 Jun 2014 09:48:57 AM CDT 
> > >> $31:3>./run_test_suite.sh
> > >> -------------------------------------------------------------------
> > >> -------------
> > >> TESTS
> > >> -------------------------------------------------------------------
> > >> -------------
> > >> ./run_test_suite.sh: 49: cd: can't cd to /test_suite/test_* Running 
> > >> test_*...
> > >> Can't find configuration file 'styles.cfg'
> > >> Can't open input file input.xml.
> > >>
> > >>    [1m[91mERROR[0m[0m
> > >>
> > >> Summary:
> > >> --------
> > >> Tests run: 1, Failures: 0, Expected failures: 0, Errors: 1
> > >>
> > >> $31:3>exit
> > >> exit
> > >>
> > >> Script done on Thu 05 Jun 2014 09:49:48 AM CDT
> > >>
> > >> John
> > For a description of the software, to download it and links to project 
> > pages go to http://www.abilitiessoft.com
> 
> --
> John J. Boyer; President, Chief Software Developer Abilitiessoft, Inc.
> http://www.abilitiessoft.com
> Madison, Wisconsin USA
> Developing software for people with disabilities
> 
> For a description of the software, to download it and links to project pages 
> go to http://www.abilitiessoft.com
> For a description of the software, to download it and links to
> project pages go to http://www.abilitiessoft.com

-- 
John J. Boyer; President, Chief Software Developer
Abilitiessoft, Inc.
http://www.abilitiessoft.com
Madison, Wisconsin USA
Developing software for people with disabilities

For a description of the software, to download it and links to
project pages go to http://www.abilitiessoft.com

Other related posts: