Tuesday, February 11, 2025

New 5,000+ page timeline of UFO news articles (2005 onwards) ... plus 7,000 related JSON files

I have now uploaded a new UFO timeline tool: a 5,000+ page chronological summary of online UFO news articles from 2005 onwards, with links to those articles.  (I have also uploaded some new related collections of thousands of files, as outlined briefly below).

This document is part of my recent effort to use AI tools to impose more order on my various collections of UFO material (and to help fill in some of the gaps in those collections).  I am also using this document as one of the tools for updating and revising my previous UFO Timeline that I shared online in 2006

I'm happy to make this new UFO timeline document freely available for anyone to download.

This new document seeks to collate information from Google News and to generate structured data based on it (in the form of a collection of about 7,000 JSON files, which I have now also shared online).  The JSON files are then used to generate a chronological table. 

I have also been experimenting with using the links in all of the JSON files to download all of these news articles and name them using a consistent filename format, but this last part in rather in a work in progress. I've shared a sample of about 1,000 PDFs to give a brief indication of the current state of this effort. (The current problems relate mainly to the scraping code I've generated using AI to properly handling cookie consent popups and related - hopefully minor - necessary improvements to my current  code before it is deployed on a much larger scale) 

(I've included links above to the 5,000 summary document, the 7,000 JSON files and the sample of 1,000 PDFs).

I'm planning on extending this project about online news articles during the next few days and then combining these relatively recent news articles with my existing collection of about 100,000 older scanned newspaper clippings about UFOs from the 1940s onwards (collated during the last couple of decades from working with over 100 different UFO groups/researchers and combining their collections). 


 




No comments:

Post a Comment