[comixed-dev] [comixed/comixed] c77877: Added new dependencies for scraper testing [#301]

  • From: "Darryl L. Pierce" <noreply@xxxxxxxxxx>
  • To: comixed-dev@xxxxxxxxxxxxx
  • Date: Sat, 18 Jul 2020 15:42:09 -0700

  Branch: refs/heads/develop
  Home:   https://github.com/comixed/comixed
  Commit: c778779c7c7a96cd0c26badc9ce3e552c802e4e4
      
https://github.com/comixed/comixed/commit/c778779c7c7a96cd0c26badc9ce3e552c802e4e4
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    M comixed-scrapers/pom.xml

  Log Message:
  -----------
  Added new dependencies for scraper testing [#301]

 - Added dependencies on okhttp and mockwebserver
 - Upgraded the DbUnit dependency to 2.7.0.


  Commit: f12d3917e9c29efaaf89a4d4d165392d38cfcb3b
      
https://github.com/comixed/comixed/commit/f12d3917e9c29efaaf89a4d4d165392d38cfcb3b
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A comixed-scrapers/src/test/resources/application.properties

  Log Message:
  -----------
  Added an application properties file for scraper testing [#301]


  Commit: b985f76bae09c0b113e9a3a5f3705c462cb66822
      
https://github.com/comixed/comixed/commit/b985f76bae09c0b113e9a3a5f3705c462cb66822
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/AbstractComicVineQueryResponse.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineCharacter.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineCredit.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineGetVolumeResponse.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineImage.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineIssue.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineLocation.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVinePublisher.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineStory.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineTeam.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineVolume.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineVolumesQueryResponse.java
    M 
comixed-scrapers/src/main/java/org/comixed/scrapers/model/ScrapingIssue.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/model/ScrapingIssueDetails.java
    M 
comixed-scrapers/src/main/java/org/comixed/scrapers/model/ScrapingVolume.java

  Log Message:
  -----------
  Changed the scraping data model [#301]


  Commit: 28f26b71b17df23aa3b8ec65af36a92f930992bd
      
https://github.com/comixed/comixed/commit/28f26b71b17df23aa3b8ec65af36a92f930992bd
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-library/src/main/java/org/comixed/model/scraping/ScrapingCache.java
    A 
comixed-library/src/main/java/org/comixed/model/scraping/ScrapingCacheEntry.java
    A 
comixed-library/src/main/resources/db/migrations/0.7.0/003_issue-301_add_scraping_cache_table.xml
    M comixed-library/src/main/resources/db/migrations/0.7.0/changelog-0.7.0.xml

  Log Message:
  -----------
  Added ScrapingCache and ScrapingCacheEntry plus migrations [#301]


  Commit: 49ffc3e2e4ebaf093d5fd429192842fc729d0c3c
      
https://github.com/comixed/comixed/commit/49ffc3e2e4ebaf093d5fd429192842fc729d0c3c
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-library/src/main/java/org/comixed/repositories/scraping/ScrapingCacheRepository.java
    A 
comixed-library/src/test/java/org/comixed/repositories/scraping/ScrapingCacheRepositoryTest.java
    M comixed-library/src/test/resources/test-database.xml
    M 
comixed-services/src/test/java/org/comixed/service/library/LibraryServiceTest.java

  Log Message:
  -----------
  Added ScrapingCacheRepository [#301]


  Commit: 35b8070574f78881b7c21a3a522db1321e42a021
      
https://github.com/comixed/comixed/commit/35b8070574f78881b7c21a3a522db1321e42a021
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-services/src/main/java/org/comixed/service/scraping/ScrapingCacheService.java
    A 
comixed-services/src/test/java/org/comixed/service/scraping/ScrapingCacheServiceTest.java

  Log Message:
  -----------
  Added ScrapingCacheService [#301]


  Commit: 4b029a8db08aec3b82807b905fd72854a5ce6e78
      
https://github.com/comixed/comixed/commit/4b029a8db08aec3b82807b905fd72854a5ce6e78
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/adaptors/AbstractScrapingAdaptor.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/adaptors/ScrapingAdaptor.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/adaptors/ScrapingCacheValueProcessor.java

  Log Message:
  -----------
  Added ScrapingAdaptor [#301]


  Commit: eb5138cc39b77e7709d55a67f60c074b83167107
      
https://github.com/comixed/comixed/commit/eb5138cc39b77e7709d55a67f60c074b83167107
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A comixed-scrapers/src/main/java/org/comixed/scrapers/ScrapingException.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/actions/AbstractScrapingAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/actions/ScrapingAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/AbstractComicVineScrapingAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/ComicVineGetVolumesAction.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/actions/ComicVineGetVolumesActionTest.java

  Log Message:
  -----------
  Added ComicVineGetVolumesAction [#301]

This commit also provides the new classes for building additional scraping 
actions.


  Commit: f7b28acf5097fb17314a5ea8a3f00f8e02f9f69f
      
https://github.com/comixed/comixed/commit/f7b28acf5097fb17314a5ea8a3f00f8e02f9f69f
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/ComicVineGetIssuesAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineIssuesQueryResponse.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/actions/ComicVineGetIssuesActionTest.java

  Log Message:
  -----------
  Added ComicVineGetIssuesAction [#301]


  Commit: f2716150767c323445a924689d1bb93e0f37e654
      
https://github.com/comixed/comixed/commit/f2716150767c323445a924689d1bb93e0f37e654
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/ComicVineGetIssueDetailsAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineGetIssueDetailsResponse.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineGetIssueResponse.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/actions/ComicVineGetIssueDetailsActionTest.java

  Log Message:
  -----------
  Added ComicVineIssueDetailsAction [#301]


  Commit: a00645cf8e222beaf3877cbf7e589cafea226f7a
      
https://github.com/comixed/comixed/commit/a00645cf8e222beaf3877cbf7e589cafea226f7a
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/ComicVineGetVolumeDetailsAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineGetVolumeDetailsResponse.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineGetVolumeResponse.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/actions/ComicVineGetVolumeDetailsActionTest.java

  Log Message:
  -----------
  Added ComicVineGetVolumeDetailsAction [#301]


  Commit: b0a2598e02d9d0efb8a081613b0bdfb598f73f13
      
https://github.com/comixed/comixed/commit/b0a2598e02d9d0efb8a081613b0bdfb598f73f13
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/ComicVineGetPublisherDetailsAction.java
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/model/ComicVineGetPublisherDetailsResponse.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/actions/ComicVineGetPublisherDetailsActionTest.java

  Log Message:
  -----------
  Added ComicVineGetPublisherDetailsAction [#301]


  Commit: f5b3a5fc20e6970c0a04a840da5346d2c81dbbe5
      
https://github.com/comixed/comixed/commit/f5b3a5fc20e6970c0a04a840da5346d2c81dbbe5
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/actions/ComicVineScrapeComicAction.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/actions/ComicVineScrapeComicActionTest.java

  Log Message:
  -----------
  Added ComicVineScrapeComicAction [#301]


  Commit: ca61922539f04002b5e403592c8533dcfb0e7aba
      
https://github.com/comixed/comixed/commit/ca61922539f04002b5e403592c8533dcfb0e7aba
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    A 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/adaptors/ComicVineScrapingAdaptor.java
    A 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/adaptors/ComicVineScrapingAdaptorTest.java

  Log Message:
  -----------
  Added ComicVineScrapingAdaptor [#301]


  Commit: becb14e0cad590fe7f9f63d2847e7e1e226c71a1
      
https://github.com/comixed/comixed/commit/becb14e0cad590fe7f9f63d2847e7e1e226c71a1
  Author: Darryl L. Pierce <mcpierce@xxxxxxxxx>
  Date:   2020-07-19 (Sun, 19 Jul 2020)

  Changed paths:
    R 
comixed-library/src/main/java/org/comixed/model/scraping/ComicVineIssue.java
    R 
comixed-library/src/main/java/org/comixed/model/scraping/ComicVinePublisher.java
    R 
comixed-library/src/main/java/org/comixed/model/scraping/ComicVineVolume.java
    R 
comixed-library/src/main/java/org/comixed/model/scraping/ComicVineVolumeQueryCacheEntry.java
    R 
comixed-library/src/main/java/org/comixed/repositories/ComicVineIssueRepository.java
    R 
comixed-library/src/main/java/org/comixed/repositories/ComicVinePublisherRepository.java
    R 
comixed-library/src/main/java/org/comixed/repositories/ComicVineVolumeQueryCacheRepository.java
    R 
comixed-library/src/main/java/org/comixed/repositories/ComicVineVolumeRepository.java
    R 
comixed-library/src/test/java/org/comixed/repositories/ComicVineVolumeQueryCacheRepositoryTest.java
    A comixed-rest-api/src/main/java/org/comixed/controller/RESTException.java
    M 
comixed-rest-api/src/main/java/org/comixed/controller/scraping/ComicVineScraperController.java
    M comixed-rest-api/src/main/java/org/comixed/net/ComicScrapeRequest.java
    M 
comixed-rest-api/src/test/java/org/comixed/controller/scraping/ComicVineScraperControllerTest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/AbstractComicVineWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/AbstractWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVineIssueDetailsWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVineIssueWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVineIssuesWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVinePublisherDetailsWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVineQueryWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVineVolumeDetailsWebRequest.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/ComicVineVolumesWebRequest.java
    R comixed-scrapers/src/main/java/org/comixed/scrapers/SimpleWebRequest.java
    R comixed-scrapers/src/main/java/org/comixed/scrapers/WebRequest.java
    R comixed-scrapers/src/main/java/org/comixed/scrapers/WebRequestClient.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/WebRequestException.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/WebRequestProcessor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineIssueDetailsResponseProcessor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineIssueResponseProcessor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVinePublisherDetailsResponseProcessor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineQueryForIssueAdaptor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineQueryForIssueDetailsAdaptor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineQueryForPublisherDetailsAdaptor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineQueryForVolumeDetailsAdaptor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineQueryForVolumesAdaptor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineResponseAdaptor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineVolumeDetailsResponseProcessor.java
    R 
comixed-scrapers/src/main/java/org/comixed/scrapers/comicvine/ComicVineVolumesResponseProcessor.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/BaseWebRequestTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/ComicVineIssueWebRequestTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/ComicVineIssuesWebRequestTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/ComicVineQueryWebRequestTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/ComicVineVolumesWebRequestTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/SimpleWebRequestTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/WebRequestProcessorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineIssueDetailsResponseProcessorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineIssueResponseProcessorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVinePublisherDetailsResponseProcessorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineQueryForIssueAdaptorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineQueryForIssueDetailsAdaptorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineQueryForPublisherDetailsAdaptorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineQueryForVolumeDetailsAdaptorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineQueryForVolumesAdaptorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineResponseAdaptorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineVolumeDetailsResponseProcessorTest.java
    R 
comixed-scrapers/src/test/java/org/comixed/scrapers/comicvine/ComicVineVolumesResponseProcessorTest.java
    M comixed-services/src/main/java/org/comixed/service/comic/ComicService.java

  Log Message:
  -----------
  Changed the scraping REST interface to use ScrapingAdaptor [#301]

 - Deleted all of the previous scraping classes.
 - Modified the requests to use Lombok annotations.
 - Added Javadoc to make the code better for new developers


Compare: https://github.com/comixed/comixed/compare/9b3e8a624e43...becb14e0cad5

Other related posts:

  • » [comixed-dev] [comixed/comixed] c77877: Added new dependencies for scraper testing [#301] - Darryl L. Pierce