Using IBM Watson’s Discovery Service to get fresh content

Fresh content on a website serves multiple purposes, including keeping you in the search engine loop. Updating your site is just as important to search engines as it is to your visitors. Search engines generally give high praises to websites that offer new information and sources for search requests. However, being desirable to search engines is not the only reason to update your site frequently.

We often find it hard to get fresh content for our website. We have to go through tonnes of websites, blog articles and much more to get a decent amount of content to share on our website.

Although there are many websites providing you content, but if you’re looking for a permanent solution you can go for IBM Watson’s Discovery service.

Watson Discovery News is a dataset of primarily English language news sources that is updated continuously, with approximately 300,000 new articles and blogs added daily.

This indexed dataset is pre-enriched with the following cognitive insights: Keyword Extraction, Entity Extraction, Concept Tagging, Relation Extraction, Sentiment Analysis, and Taxonomy Classification.

The following additional metadata is also added: crawl date, publication date, URL ranking, host rank, and anchor text. Historical search is available for the past 60 days of news data.

IBM Watson

You can integrate it in your website and start publishing content from within your system. Implementation is fairly easy. I recently had an opportunity to integrate it in one of the products i am working on. It is a simple curl api call done using a proper authentications. It has wide variety of filters, aggregations to refine your results and give what exactly you require for your website.

You can download it from Github Repo:

Installation is fairly easy:

  • Download the code.
  • Extract it and add DiscoveryApi.php in project
  • Then use the following code to start using it:

$alchemy = new DiscoveryApi();
$data = $alchemy->queryCollection("IBM", "", "1 day");
echo "<pre>";print_r($data);


By Abhishek Jain

Techie with 10+ years of experience and counting.

Leave a comment

Your email address will not be published. Required fields are marked *