[liblouis-liblouisxml] Re: Why is there an error in this test run?
- From: "John J. Boyer" <john.boyer@xxxxxxxxxxxxxxxxx>
- To: liblouis-liblouisxml@xxxxxxxxxxxxx
- Date: Fri, 6 Jun 2014 12:02:24 -0500
I think that's a good idea.
John
On Fri, Jun 06, 2014 at 05:26:55PM +0200, Mesar Hameed wrote:
> Hi,
> Its probably best if the user is redirected to the mailinglist and to the
> website
> rather than a particular individual.
>
> thanks,
> Mesar
> On Fri 06/06/14,17:24, Bert Frees wrote:
> > The difference between the output and the expected result appears to be
> > only whitespace. Either the expected result should be adjusted or we
> > should have a more advanced output comparing that ignores whitespace at
> > the end of lines (right now it is just using diff).
> >
> > For the record, I'm not the responsible person either, you knew that :)
> > I'm only trying to help out because I wrote those tests but I have my
> > hands full with liblouis.
> >
> > Bert
> >
> > John J. Boyer writes:
> >
> > > Keith,
> > >
> > > This looks good as far as the output of the test run is concerned. I
> > > don't know why failures are expected. It's something for Bert to
> > > explain. Shouldn't he be the one to receive bug reports? I'm no longer
> > > the appropriate person.
> > >
> > > John
> > >
> > > On Fri, Jun 06, 2014 at 02:57:08PM +0000, Keith Creasy wrote:
> > >> John, I did run the liblouisutdml tests:
> > >>
> > >> Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0
> > >>
> > >> FAIL: run_test_suite.sh
> > >> =============================================
> > >> 1 of 3 tests failed
> > >> Please report to john.boyer@xxxxxxxxxxxxxxxxx
> > >>
> > >>
> > >> Why does it expect 7 failures?
> > >>
> > >>
> > >> Here is the entire output:
> > >>
> > >> Making check in gnulib
> > >> make[1]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/gnulib'
> > >> make check-recursive
> > >> make[2]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/gnulib'
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/gnulib'
> > >> make[3]: Nothing to be done for `check-am'.
> > >> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> > >> make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> > >> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/gnulib'
> > >> Making check in doc
> > >> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/doc'
> > >> make[1]: Nothing to be done for `check'.
> > >> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/doc'
> > >> Making check in lbu_files
> > >> make[1]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/lbu_files'
> > >> make[1]: Nothing to be done for `check'.
> > >> make[1]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/lbu_files'
> > >> Making check in liblouisutdml
> > >> make[1]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
> > >> make[1]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/liblouisutdml'
> > >> Making check in tests
> > >> make[1]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> Making check in test_suite
> > >> make[2]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> > >> Making check in test_01
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_01'
> > >> Making check in test_02
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_02'
> > >> Making check in test_03
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_03'
> > >> Making check in test_04
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_04'
> > >> Making check in test_05
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_05'
> > >> Making check in test_06
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_06'
> > >> Making check in test_07
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_07'
> > >> Making check in test_08
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_08'
> > >> Making check in test_09
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_09'
> > >> Making check in test_10
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_10'
> > >> Making check in test_11
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_11'
> > >> Making check in test_12
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_12'
> > >> Making check in test_13
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
> > >> make[3]: Nothing to be done for `check'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite/test_13'
> > >> make[3]: Entering directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> > >> make[3]: Nothing to be done for `check-am'.
> > >> make[3]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> > >> make[2]: Leaving directory
> > >> `/home/kcreasy/workspace/liblouisutdml/tests/test_suite'
> > >> make[2]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> make testTranslateString tripleTrans \
> > >> run_test_suite.sh
> > >> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> make[3]: `testTranslateString' is up to date.
> > >> make[3]: `tripleTrans' is up to date.
> > >> make[3]: Nothing to be done for `run_test_suite.sh'.
> > >> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> make check-TESTS
> > >> make[3]: Entering directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> XFAIL: testTranslateString
> > >> PASS: tripleTrans
> > >> --------------------------------------------------------------------------------
> > >> TESTS
> > >> --------------------------------------------------------------------------------
> > >> Running test_01...
> > >> Testing pagenum, runninghead and footer semantic actions
> > >> \033[1m\033[91mFAIL\033[0m\033[0m
> > >> Running test_02...
> > >> Testing footer when some text immediately precedes the footer element
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >> Running test_03...
> > >> footer bug
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >> Running test_04...
> > >> Testing prehyphenation
> > >> \033[1m\033[92mPASS\033[0m\033[0m
> > >> Running test_05...
> > >> Testing printPageNumberRange option with printPageNumberAt=bottom
> > >> \033[1m\033[92mPASS\033[0m\033[0m
> > >> Running test_06...
> > >> Testing printPageNumberRange option with printPageNumberAt=top
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >> Running test_07...
> > >> Testing orphanControl
> > >> \033[1m\033[92mPASS\033[0m\033[0m
> > >> Running test_08...
> > >> Testing nested orphanControl. Outer orphanControl assertion should
> > >> not be
> > >> dropped when inner orphanControl is encountered.
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >> Running test_09...
> > >> Testing hyphenation
> > >> \033[1m\033[92mPASS\033[0m\033[0m
> > >> Running test_10...
> > >> Testing negative firstLineIndent
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >> Running test_11...
> > >> Testing braille page numbering table (pageNumberTable)
> > >> \033[1m\033[92mPASS\033[0m\033[0m
> > >> Running test_12...
> > >> Testing whitespace-only text-node in mixed content.
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >> Running test_13...
> > >> Testing printPageNumberRange when a page break in print happens right
> > >> before
> > >> a page break in braille (fails when printPageNumberAt=bottom)
> > >> \033[1m\033[93mXFAIL\033[0m\033[0m
> > >>
> > >> Summary:
> > >> --------
> > >> Tests run: 13, Failures: 1, Expected failures: 7, Errors: 0
> > >>
> > >> FAIL: run_test_suite.sh
> > >> =============================================
> > >> 1 of 3 tests failed
> > >> Please report to john.boyer@xxxxxxxxxxxxxxxxx
> > >> =============================================
> > >> make[3]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> make[2]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> make[1]: Leaving directory `/home/kcreasy/workspace/liblouisutdml/tests'
> > >> Keith
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx
> > >> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of John J.
> > >> Boyer
> > >> Sent: Friday, June 06, 2014 5:30 AM
> > >> To: liblouis-liblouisxml@xxxxxxxxxxxxx
> > >> Subject: [liblouis-liblouisxml] Re: Why is there an error in this test
> > >> run?
> > >>
> > >> Bert,
> > >>
> > >> Thanks. We'll be adding some tests to check UTDML .
> > >>
> > >> John
> > >>
> > >> On Fri, Jun 06, 2014 at 11:13:32AM +0200, Bert Frees wrote:
> > >> > Keith and John,
> > >> >
> > >> > There was a bug in the script indeed when run by itself and not
> > >> > through `make check`. I fixed that bug now, but it doesn't matter
> > >> > really. The script is supposed to be run with make check anyway
> > >> > because make takes care of setting LD_LIBRARY_PATH etc.
> > >> >
> > >> > You may also consider setting the `colors` var in the script to false.
> > >> > It is merely a visual help for myself, but I noticed from your emails
> > >> > that it produces garbage in your shell.
> > >> >
> > >> > Thanks,
> > >> > Bert
> > >> >
> > >> >
> > >> > Bert Frees writes:
> > >> >
> > >> > > This used to work. Haven't used it for a while. Let me check what's
> > >> > > wrong.
> > >> > >
> > >> > > Bert
> > >> > >
> > >> > > Keith Creasy writes:
> > >> > >
> > >> > >> Yes, this is what I found also. Thanks.
> > >> > >>
> > >> > >>
> > >> > >> -----Original Message-----
> > >> > >> From: liblouis-liblouisxml-bounce@xxxxxxxxxxxxx
> > >> > >> [mailto:liblouis-liblouisxml-bounce@xxxxxxxxxxxxx] On Behalf Of
> > >> > >> John J. Boyer
> > >> > >> Sent: Thursday, June 05, 2014 10:56 AM
> > >> > >> To: liblouis-liblouisxml@xxxxxxxxxxxxx
> > >> > >> Subject: [liblouis-liblouisxml] Why is there an error in this test
> > >> > >> run?
> > >> > >>
> > >> > >> Below is a typescript of running the tests in liblouisutdml. There
> > >> > >> seems to be a problem in finding things.
> > >> > >>
> > >> > >> Script started on Thu 05 Jun 2014 09:48:57 AM CDT
> > >> > >> $31:3>./run_test_suite.sh
> > >> > >> -------------------------------------------------------------------
> > >> > >> -------------
> > >> > >> TESTS
> > >> > >> -------------------------------------------------------------------
> > >> > >> -------------
> > >> > >> ./run_test_suite.sh: 49: cd: can't cd to /test_suite/test_* Running
> > >> > >> test_*...
> > >> > >> Can't find configuration file 'styles.cfg'
> > >> > >> Can't open input file input.xml.
> > >> > >>
> > >> > >> [1m[91mERROR[0m[0m
> > >> > >>
> > >> > >> Summary:
> > >> > >> --------
> > >> > >> Tests run: 1, Failures: 0, Expected failures: 0, Errors: 1
> > >> > >>
> > >> > >> $31:3>exit
> > >> > >> exit
> > >> > >>
> > >> > >> Script done on Thu 05 Jun 2014 09:49:48 AM CDT
> > >> > >>
> > >> > >> John
> > >> > For a description of the software, to download it and links to project
> > >> > pages go to http://www.abilitiessoft.com
> > >>
> > >> --
> > >> John J. Boyer; President, Chief Software Developer Abilitiessoft, Inc.
> > >> http://www.abilitiessoft.com
> > >> Madison, Wisconsin USA
> > >> Developing software for people with disabilities
> > >>
> > >> For a description of the software, to download it and links to project
> > >> pages go to http://www.abilitiessoft.com
> > >> For a description of the software, to download it and links to
> > >> project pages go to http://www.abilitiessoft.com
> >
> > For a description of the software, to download it and links to
> > project pages go to http://www.abilitiessoft.com
--
John J. Boyer; President, Chief Software Developer
Abilitiessoft, Inc.
http://www.abilitiessoft.com
Madison, Wisconsin USA
Developing software for people with disabilities
For a description of the software, to download it and links to
project pages go to http://www.abilitiessoft.com
Other related posts:
