ed-news/tests/fixtures/ at main · ebardelli.com/ed-news · Tangled

ebardelli.com / ed-news

0

A compact static site generator and feed builder for curated education news ed-news.ebardelli.com

0

ed-news / tests / fixtures /

at main 14 files

Emanuele Bardelli Update calmatters preprocessor 6w ago

10.1016-j.jmathb.2025.101284.json

Update calmatters preprocessor They turned off the rss feed, so I need to extract the articles from the page directly.

1 month ago

Add RSS feed fixture and update tests for feed parsing and ISSN handling - Created a new RSS feed fixture file `aera.rss` containing entries from the American Educational Research Journal. - Updated `test_fetch_feed_parses_entries` to utilize the new fixture for testing feed parsing, ensuring at least one entry is present. - Added a new test file `test_issn_tuple_shapes.py` to verify that feeds with extra fields are processed correctly, including inserting articles from a mocked Crossref JSON response.

10 months ago

Add edworkingpapers - Implemented tests for the edworkingpapers processor to ensure proper parsing of HTML fixtures and validation of output fields. - Added tests for the edworkingpapers processor to confirm that no DOI is fabricated during preprocessing. - Created tests for the edworkingpapers postprocessor to verify fetching and upserting articles into the database. - Developed tests for the sciencedirect postprocessor to ensure articles are upserted correctly and DOIs are attached. - Introduced tests for the RSS preprocessor to validate its integration within the CLI. - Added tests for the database postprocessor invocation to ensure proper execution of pre and post-processing steps. - Removed obsolete test for enrich_crossref flags from the TUI tests.

9 months ago

calmatters.html

Update calmatters preprocessor They turned off the rss feed, so I need to extract the articles from the page directly.

1 month ago

crossref_expected.json

Move to ednews python module

10 months ago

crossref_json_created_fixture.json

Remove authors from citations and prefer creation date if available

10 months ago

crossref_unixref.xml

Add more tests

10 months ago

edpolicyinca_article.html

Add PACE (edpolicyinca.org) feed processors with listing-page extraction Scrape publications and commentaries listings directly instead of fetching individual article pages, eliminating rate-limit issues. Two separate preprocessors handle the different HTML structures for publications (.field--name-body) and commentaries (.field--name-field-summary). Postprocessors read summary and authors from the items table (no HTTP). Add `authors` column to items table with migration, save authors through feeds.py INSERT and the url_hash-match UPDATE path. Update test fixtures to use live pages so selector regressions are caught automatically.

1 month ago

edpolicyinca_commentaries_listing.html

Add PACE (edpolicyinca.org) feed processors with listing-page extraction Scrape publications and commentaries listings directly instead of fetching individual article pages, eliminating rate-limit issues. Two separate preprocessors handle the different HTML structures for publications (.field--name-body) and commentaries (.field--name-field-summary). Postprocessors read summary and authors from the items table (no HTTP). Add `authors` column to items table with migration, save authors through feeds.py INSERT and the url_hash-match UPDATE path. Update test fixtures to use live pages so selector regressions are caught automatically.

1 month ago

edpolicyinca_listing.html

Add PACE (edpolicyinca.org) feed processors with listing-page extraction Scrape publications and commentaries listings directly instead of fetching individual article pages, eliminating rate-limit issues. Two separate preprocessors handle the different HTML structures for publications (.field--name-body) and commentaries (.field--name-field-summary). Postprocessors read summary and authors from the items table (no HTTP). Add `authors` column to items table with migration, save authors through feeds.py INSERT and the url_hash-match UPDATE path. Update test fixtures to use live pages so selector regressions are caught automatically.

1 month ago

edworkingpapers.html

Add edworkingpapers - Implemented tests for the edworkingpapers processor to ensure proper parsing of HTML fixtures and validation of output fields. - Added tests for the edworkingpapers processor to confirm that no DOI is fabricated during preprocessing. - Created tests for the edworkingpapers postprocessor to verify fetching and upserting articles into the database. - Developed tests for the sciencedirect postprocessor to ensure articles are upserted correctly and DOIs are attached. - Introduced tests for the RSS preprocessor to validate its integration within the CLI. - Added tests for the database postprocessor invocation to ensure proper execution of pre and post-processing steps. - Removed obsolete test for enrich_crossref flags from the TUI tests.

9 months ago

Add news section

10 months ago

Add Press Democrat's local education news - Created a new test file `test_pd_feed_filter.py` to validate the functionality of the PD feed processor, ensuring it filters and retains only local news items. - Implemented a dummy session and response class to simulate HTTP requests and responses for testing. - Added assertions to check the structure and content of the fetched news items. - Created a new test file `test_pressdemocrat_helpers.py` to test the local news category detection logic in the Press Democrat processor. - Added multiple test cases to verify the handling of various tag formats, case insensitivity, and fallback mechanisms for missing tags. - Ensured robustness by testing against malformed tag entries and confirming correct behavior in edge cases.

10 months ago

read_articles_limit.sql

Always default to 20 or more articles

10 months ago