News_Virality_Prediction.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "News-Virality-Prediction.ipynb",
      "provenance": [],
      "collapsed_sections": []
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oBlOmDhBgsNU",
        "colab_type": "text"
      },
      "source": [
        "**Problem Statement**\n",
        "\n",
        "Aim of this project is to predict the virality of news articles.\n",
        "\n",
        "I approached this problem \n",
        "\n",
        "* first we gonna scrap the news data from the indiatimes or choose diff website using beautiful soup.\n",
        "* To train a machine learning model will use the UCI news data. Apply that trained model to predict the virality.\n",
        "* Here I explained the term virality with the number of shares(how many times does the article is shared) article gonna have.\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "VPWP6KiFQ6rC",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 394
        },
        "outputId": "8be57331-d920-4e83-ddb6-95607108b06c"
      },
      "source": [
        "# Install the newspaper library\n",
        "! pip install newspaper3k"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Requirement already satisfied: newspaper3k in /usr/local/lib/python3.6/dist-packages (0.2.8)\n",
            "Requirement already satisfied: beautifulsoup4>=4.4.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (4.6.3)\n",
            "Requirement already satisfied: cssselect>=0.9.2 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (1.1.0)\n",
            "Requirement already satisfied: lxml>=3.6.0 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (4.2.6)\n",
            "Requirement already satisfied: PyYAML>=3.11 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (3.13)\n",
            "Requirement already satisfied: tinysegmenter==0.3 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (0.3)\n",
            "Requirement already satisfied: feedparser>=5.2.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (5.2.1)\n",
            "Requirement already satisfied: feedfinder2>=0.0.4 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (0.0.4)\n",
            "Requirement already satisfied: Pillow>=3.3.0 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (7.0.0)\n",
            "Requirement already satisfied: nltk>=3.2.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (3.2.5)\n",
            "Requirement already satisfied: tldextract>=2.0.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (2.2.2)\n",
            "Requirement already satisfied: python-dateutil>=2.5.3 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (2.8.1)\n",
            "Requirement already satisfied: requests>=2.10.0 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (2.23.0)\n",
            "Requirement already satisfied: jieba3k>=0.35.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (0.35.1)\n",
            "Requirement already satisfied: six in /usr/local/lib/python3.6/dist-packages (from feedfinder2>=0.0.4->newspaper3k) (1.12.0)\n",
            "Requirement already satisfied: idna in /usr/local/lib/python3.6/dist-packages (from tldextract>=2.0.1->newspaper3k) (2.10)\n",
            "Requirement already satisfied: setuptools in /usr/local/lib/python3.6/dist-packages (from tldextract>=2.0.1->newspaper3k) (49.1.0)\n",
            "Requirement already satisfied: requests-file>=1.4 in /usr/local/lib/python3.6/dist-packages (from tldextract>=2.0.1->newspaper3k) (1.5.1)\n",
            "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests>=2.10.0->newspaper3k) (1.24.3)\n",
            "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests>=2.10.0->newspaper3k) (3.0.4)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests>=2.10.0->newspaper3k) (2020.6.20)\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4iRDw_YuR2lm",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "# import all the required libraries\n",
        "import requests\n",
        "from bs4 import BeautifulSoup\n",
        "from newspaper import Article  \n",
        "import csv \n",
        "import pandas as pd\n",
        "import numpy as np"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bMEKGzByR9nz",
        "colab_type": "text"
      },
      "source": [
        "To work with the text data we need to import Natural language took kit library i.e nltk"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KVnN3RD5SG6L",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 68
        },
        "outputId": "7f00b402-edcb-4634-8547-e6e3a1189b43"
      },
      "source": [
        "import nltk\n",
        "nltk.download('punkt')"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "[nltk_data] Downloading package punkt to /root/nltk_data...\n",
            "[nltk_data]   Package punkt is already up-to-date!\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "True"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 29
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FPA7XoIlSJqV",
        "colab_type": "text"
      },
      "source": [
        "**Start the Scraping**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ul-VJgPXSNTX",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "news_url = \"https://timesofindia.indiatimes.com/world\"\n",
        "r = requests.get(news_url)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "JixTKQQBSiC5",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "soup = BeautifulSoup(r.content, 'html5lib') \n",
        "table = soup.findAll('a', attrs = {'class':'w_img'})"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Srbh3hX-Sn8Z",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "news=[]\n",
        "for row in table: \n",
        "    if not row['href'].startswith('http'):\n",
        "        news.append('https://timesofindia.indiatimes.com'+row['href'])"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oyAWF9NVTWvS",
        "colab_type": "text"
      },
      "source": [
        "\n",
        "Create a list to store all the data formates in the form of dictionary."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "0rJG-WiNTbKS",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "df=[]\n",
        "for i in news:\n",
        "    article = Article(i, language=\"en\")\n",
        "    article.download() \n",
        "    article.parse() \n",
        "    article.nlp() \n",
        "    data={}\n",
        "    data['Title']=article.title\n",
        "    data['Text']=article.text\n",
        "    data['Summary']=article.summary\n",
        "    data['Keywords']=article.keywords\n",
        "    df.append(data)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "tLt4y9LNTeKG",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "ecb0b6bb-7eee-46fd-b0cd-25d1828da93d"
      },
      "source": [
        "# check the list\n",
        "df"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "[{'Keywords': ['announced',\n",
              "   'terror',\n",
              "   'bill',\n",
              "   'ms13',\n",
              "   'diaz',\n",
              "   'justice',\n",
              "   'gang',\n",
              "   'barr',\n",
              "   'conspiracy',\n",
              "   'drug',\n",
              "   'leader',\n",
              "   'department',\n",
              "   'charges'],\n",
              "  'Summary': 'Attorney General Bill Barr announced the charges against Salvador-based gang leader Armando Eliu Melgar Diaz a... Read MoreWASHINGTON: The US Justice Department announced Wednesday it is using terrorism charges for the first time to indict a member of the notoriously violent MS-13 gang.\\nAttorney General Bill Barr announced the charges against Salvador-based gang leader Armando Eliu Melgar Diaz at a White House event meant to highlight the Trump administration\\'s efforts to crack down on the group.\\nThe Justice Department accused Diaz with conspiracy to provide material support to terrorists and conspiracy to cross-border terror acts, along with narco-terror financing and other charges.\\nThe department did not explain why it was using terror charges for the first time against the gang, but it noted that the Salvadoran government had designated MS-13 a terror group.\\n\"MS-13 is a violent transnational criminal organization, whose criminal activities respect no boundaries,\" said John Durham, the Justice Department official in charge of a special task force to investigate MS-13.',\n",
              "  'Text': 'Attorney General Bill Barr announced the charges against Salvador-based gang leader Armando Eliu Melgar Diaz a... Read More\\n\\nWASHINGTON: The US Justice Department announced Wednesday it is using terrorism charges for the first time to indict a member of the notoriously violent MS-13 gang.\\n\\nAttorney General Bill Barr announced the charges against Salvador-based gang leader Armando Eliu Melgar Diaz at a White House event meant to highlight the Trump administration\\'s efforts to crack down on the group.\\n\\nIn an indictment unsealed in the federal court in Alexandria, Virginia, Diaz was accused of directing MS-13 activities in the US East Coast region, ordering and approving numerous murders and overseeing drug deals while collecting payments from around 20 local MS-13 cliques.\\n\\nThe Justice Department accused Diaz with conspiracy to provide material support to terrorists and conspiracy to cross-border terror acts, along with narco-terror financing and other charges.\\n\\nThe department did not explain why it was using terror charges for the first time against the gang, but it noted that the Salvadoran government had designated MS-13 a terror group.\\n\\n\"MS-13 is a violent transnational criminal organization, whose criminal activities respect no boundaries,\" said John Durham, the Justice Department official in charge of a special task force to investigate MS-13.\\n\\n\"The only way to defeat MS-13 is by targeting the organization as a whole, focusing on the leadership structure, and deploying a whole-of-government approach against a common enemy,\" Durham said in a statement.\\n\\nDiaz lived illegally in the United States, mostly in Virginia, from 2003 to 2016 when he was deported, according to the indictment.\\n\\nAfter that, he became the gang\\'s main coordinator for its eastern US operations based in El Salvador .\\n\\nHe is currently under arrest in El Salvador, facing charges of drug trafficking and conspiracy to commit murder.\\n\\nMeanwhile, federal prosecutors announced Wednesday the indictments of 21 MS-13 members in New York and Nevada who belong to US operations separate from those run by Diaz.\\n\\nCharges against those involved include murder, kidnapping, drug trafficking and weapons violations.\\n\\nThe Justice Department also said it would seek the death penalty for a notorious MS-13 hit man in New York, Alexi Saenz, who was indicted in 2017 for seven murders.\\n\\n',\n",
              "  'Title': 'Bill Barr: In first, US charges MS-13 leader with terror'},\n",
              " {'Keywords': ['training',\n",
              "   'covid19',\n",
              "   'sniffing',\n",
              "   'trained',\n",
              "   'sniff',\n",
              "   'dogs',\n",
              "   'used',\n",
              "   'sweat',\n",
              "   'chilean',\n",
              "   'train',\n",
              "   'toiinpolice',\n",
              "   'times',\n",
              "   'detect',\n",
              "   'working'],\n",
              "  'Summary': 'Jul 15, 2020, 09:28PM ISTSource: TOI.inPolice in Chile are training dogs to detect people that may be infected with the novel coronavirus by sniffing their sweat.\\nThe dogs -- three golden retrievers and a labrador -- are between the ages of four and five.\\nUntil now they have been used to sniff out illicit drugs, explosives and lost people.\\nDogs have 330 million olfactory receptors, and an ability to detect smells 50 times better than humans.\\nThe experts hope to have the dogs trained and working in the field by August.',\n",
              "  'Text': 'Jul 15, 2020, 09:28PM IST\\n\\nSource: TOI.in\\n\\nPolice in Chile are training dogs to detect people that may be infected with the novel coronavirus by sniffing their sweat. The dogs -- three golden retrievers and a labrador -- are between the ages of four and five. Until now they have been used to sniff out illicit drugs, explosives and lost people. Dogs have 330 million olfactory receptors, and an ability to detect smells 50 times better than humans. They can also smell 250 people per hour. The experts hope to have the dogs trained and working in the field by August.',\n",
              "  'Title': 'Chilean police train dogs to sniff out Covid-19'},\n",
              " {'Keywords': ['understanding',\n",
              "   'hunt',\n",
              "   'tens',\n",
              "   'desperation',\n",
              "   'virus',\n",
              "   'thousands',\n",
              "   'solutions',\n",
              "   'drugs',\n",
              "   'world',\n",
              "   'tragic',\n",
              "   'studies',\n",
              "   'science',\n",
              "   'slows',\n",
              "   'solve',\n",
              "   'system'],\n",
              "  'Summary': 'Jul 08, 2020, 10:27PM ISTSource: APDesperate to solve the deadly conundrum of COVID-19, the world is clamoring for fast answers and solutions from a research system not built for haste.\\nThe ironic, and perhaps tragic, result: Scientific shortcuts have slowed understanding of the disease and delayed the ability to find out which drugs help, hurt or have no effect at all.\\nAs deaths from the coronavirus relentlessly mounted into the hundreds of thousands, tens of thousands of doctors and patients rushed to use drugs before they could be proved safe or effective.\\nA slew of low-quality studies clouded the picture even more.',\n",
              "  'Text': 'Jul 08, 2020, 10:27PM IST\\n\\nSource: AP\\n\\nDesperate to solve the deadly conundrum of COVID-19, the world is clamoring for fast answers and solutions from a research system not built for haste. The ironic, and perhaps tragic, result: Scientific shortcuts have slowed understanding of the disease and delayed the ability to find out which drugs help, hurt or have no effect at all. As deaths from the coronavirus relentlessly mounted into the hundreds of thousands, tens of thousands of doctors and patients rushed to use drugs before they could be proved safe or effective. A slew of low-quality studies clouded the picture even more.',\n",
              "  'Title': 'Desperation science slows hunt for virus drugs'},\n",
              " {'Keywords': ['saint',\n",
              "   'roman',\n",
              "   'lost',\n",
              "   'months',\n",
              "   'reopens',\n",
              "   'parishioners',\n",
              "   'queens',\n",
              "   'nearly',\n",
              "   'church',\n",
              "   'york',\n",
              "   'covidravaged',\n",
              "   'services',\n",
              "   'reopened'],\n",
              "  'Summary': 'Jul 08, 2020, 10:19PM ISTSource: APAfter losing at least 74 parishioners to COVID-19, Saint Bartholomew Roman Catholic Church in Queens, New York reopened for its first in-person services in nearly four months.\\nIn attendance was Claudia Balderas, who lost her brother to the coronavirus.',\n",
              "  'Text': 'Jul 08, 2020, 10:19PM IST\\n\\nSource: AP\\n\\nAfter losing at least 74 parishioners to COVID-19, Saint Bartholomew Roman Catholic Church in Queens, New York reopened for its first in-person services in nearly four months. In attendance was Claudia Balderas, who lost her brother to the coronavirus.',\n",
              "  'Title': 'COVID-ravaged New York church reopens'},\n",
              " {'Keywords': ['edge',\n",
              "   'places',\n",
              "   'voting',\n",
              "   'likely',\n",
              "   'presidential',\n",
              "   'america',\n",
              "   'nears',\n",
              "   'saginaw',\n",
              "   'michigan',\n",
              "   'trump',\n",
              "   'jul',\n",
              "   'narrowly',\n",
              "   'election',\n",
              "   'obama',\n",
              "   'disrupted',\n",
              "   'istsource'],\n",
              "  'Summary': 'Jul 07, 2020, 09:54PM ISTSource: APAmerica Disrupted: It is in places like Saginaw County, Michigan - which narrowly flipped from voting for Barack Obama to voting for Donald Trump - where clarity about a divided America’s future is likely to come.',\n",
              "  'Text': 'Jul 07, 2020, 09:54PM IST\\n\\nSource: AP\\n\\nAmerica Disrupted: It is in places like Saginaw County, Michigan - which narrowly flipped from voting for Barack Obama to voting for Donald Trump - where clarity about a divided America’s future is likely to come.',\n",
              "  'Title': 'America disrupted: US on edge as presidential election nears'},\n",
              " {'Keywords': ['ventilators',\n",
              "   'makes',\n",
              "   'ventilator',\n",
              "   'machines',\n",
              "   'kladno',\n",
              "   'ordinary',\n",
              "   'team',\n",
              "   'mico',\n",
              "   'roubik',\n",
              "   'kapler',\n",
              "   'needed',\n",
              "   'offered',\n",
              "   'parts',\n",
              "   'czech',\n",
              "   'working'],\n",
              "  'Summary': 'Jul 07, 2020, 09:53PM ISTSource: APTomas Kapler knew nothing about ventilators - he\\'s an online business consultant, not an engineer or a medical technician.\\nWorking around the clock, he brought together a team of 30 Czechs to develop a fully functional ventilator - Corovent.\\nSo Kapler said he set out to \"make a ventilator from the parts that are used in common machines.\"\\nKapler approached Karel Roubik, professor of Biomedical Engineering at the Czech Technical University for help.\\nAnd then MICO, an energy and chemical company based in Trebic, 200 kilometers (125 miles) from Kladno, offered to do the manufacturing.',\n",
              "  'Text': 'Jul 07, 2020, 09:53PM IST\\n\\nSource: AP\\n\\nTomas Kapler knew nothing about ventilators - he\\'s an online business consultant, not an engineer or a medical technician. But when he saw that shortages of the vital machines had imperiled critically ill COVID-19 patients in northern Italy, he was moved to action. Working around the clock, he brought together a team of 30 Czechs to develop a fully functional ventilator - Corovent. And they did it in a matter of days. Kapler is a member of an informal group of volunteers formed by IT companies and experts who offered to help the state fight the pandemic. Ventilators had become a precious commodity. Their price was skyrocketing and so was demand that the traditional makers were unable to immediately meet. Components for the ventilators were also in critically short supply. So Kapler said he set out to \"make a ventilator from the parts that are used in common machines.\" A crowd-funding campaign ensured the necessary finances in just hours. Kapler approached Karel Roubik, professor of Biomedical Engineering at the Czech Technical University for help. He, in turn, assembled colleagues through Skype, while his post-graduate student tested the new design in their lab in Kladno, west of Prague. They had a working prototype in five days, something that would normally take a year. Roubik said their simple design makes the machine reliable, inexpensive, and easy to operate and mass produce. A group of volunteer pilots flew their planes to deliver anything needed. And then MICO, an energy and chemical company based in Trebic, 200 kilometers (125 miles) from Kladno, offered to do the manufacturing. Flights between the two places helped fine-tune the production line in a few weeks. With the certification for emergency use in the European Union approved, the ventilator was ready in April - but it was not needed in the Czech Republic, which had managed to contain the outbreak. MICO has submitted a request for approval for emergency use in the United States, Brazil, Russia and other countries. Meanwhile, they\\'ve applied for EU certification for common hospital use. Kapler looks back at the effort with satisfaction.',\n",
              "  'Title': \"Czech team makes ventilators from 'ordinary' parts\"},\n",
              " {'Keywords': ['white',\n",
              "   'wallace',\n",
              "   'saying',\n",
              "   'trump',\n",
              "   'hate',\n",
              "   'confederate',\n",
              "   'nascar',\n",
              "   'crime',\n",
              "   'trumps',\n",
              "   'donald',\n",
              "   'tries',\n",
              "   'clarify',\n",
              "   'flag',\n",
              "   'rope',\n",
              "   'house',\n",
              "   'series'],\n",
              "  'Summary': 'Trump suggested Wallace should apologize after one of his crew members discovered the rope in a garage stall they had been assigned to.\\nFederal authorities ruled last month that the rope had been hanging there since at least last October and was not a hate crime.\\n\"The whole point of the tweet was to note the incident, the alleged hate crime that was not in fact a hate crime,\" she said.\\nHe has worn a shirt saying “I Can’t Breathe,\" raced with a Black Lives Matter paint scheme in Virginia and successfully lobbied for NASCAR\\'s Confederate flag ban.\\nThe series first tried to ban the Confederate flag five years ago but did nothing to enforce the order.',\n",
              "  'Text': 'Jul 07, 2020, 09:51PM IST\\n\\nSource: AP\\n\\nUS President Donald Trump blasted NASCAR for banning the Confederate flag and wrongly accused the sport\\'s only Black driver, Bubba Wallace, of perpetrating “a hoax” involving a rope shaped like a noose in his garage. Trump suggested Wallace should apologize after one of his crew members discovered the rope in a garage stall they had been assigned to. Federal authorities ruled last month that the rope had been hanging there since at least last October and was not a hate crime. Wallace has maintained the rope had been fashioned into a noose and has said he was saddened by “the despicable act of racism and hatred,\" and other Cup Series drivers rallied around him. “Has BubbaWallace apologized to all of those great NASCAR drivers & officials who came to his aid, stood by his side, & were willing to sacrifice everything for him, only to find out that the whole thing was just another HOAX?\" Trump tweeted. \"That & Flag decision has caused lowest ratings EVER!” White House press secretary Kayleigh McEnany defended the president\\'s decision to wade into the Wallace case, saying that reporters were mischaracterizing the president\\'s tweet and were taking his comments about the Confederate flag out of context. \"The whole point of the tweet was to note the incident, the alleged hate crime that was not in fact a hate crime,\" she said. McEnany said the president \"rejects this notion that somehow NASCAR men and women, who go to these sporting events, are racists,\" and that the FBI report on the matter was an \"indictment of the media\\'s rush to judgment.\" Wallace, an Alabama native, has taken an active role in the push for racial equality. He has worn a shirt saying “I Can’t Breathe,\" raced with a Black Lives Matter paint scheme in Virginia and successfully lobbied for NASCAR\\'s Confederate flag ban. For more than 70 years, the flag was a common and complicated sight at NASCAR races. The series first tried to ban the Confederate flag five years ago but did nothing to enforce the order. While Trump claimed NASCAR\\'s ratings are down, they are actually up.',\n",
              "  'Title': 'US: White House tries to clarify Donald Trump’s NASCAR tweet'},\n",
              " {'Keywords': ['reveals',\n",
              "   'istsource',\n",
              "   'diagnosis',\n",
              "   'covid19',\n",
              "   'positive',\n",
              "   'prince',\n",
              "   'jul',\n",
              "   'royce',\n",
              "   'holiday',\n",
              "   'learn',\n",
              "   'tests',\n",
              "   'shock',\n",
              "   'hopes'],\n",
              "  'Summary': 'Jul 03, 2020, 08:59PM ISTSource: APAhead of the July 4th holiday, Prince Royce reveals his shock at his own COVID-19 diagnosis.\\nHe hopes people will learn from him and be cautious.',\n",
              "  'Text': 'Jul 03, 2020, 08:59PM IST\\n\\nSource: AP\\n\\nAhead of the July 4th holiday, Prince Royce reveals his shock at his own COVID-19 diagnosis. He hopes people will learn from him and be cautious.',\n",
              "  'Title': 'Prince Royce tests positive for Covid-19'},\n",
              " {'Keywords': ['istsource',\n",
              "   'hotel',\n",
              "   'tourism',\n",
              "   'jul',\n",
              "   'rome',\n",
              "   'project',\n",
              "   'worst',\n",
              "   'turn',\n",
              "   'ww2',\n",
              "   'underway',\n",
              "   'luxury',\n",
              "   'course',\n",
              "   'despite',\n",
              "   'stays'],\n",
              "  'Summary': 'Jul 03, 2020, 08:54PM ISTSource: APRenovations underway to turn Rome building into new Bulgari hotel, despite worst tourism crisis since WW2.',\n",
              "  'Text': 'Jul 03, 2020, 08:54PM IST\\n\\nSource: AP\\n\\nRenovations underway to turn Rome building into new Bulgari hotel, despite worst tourism crisis since WW2.',\n",
              "  'Title': 'Luxury hotel project stays its course in Rome'},\n",
              " {'Keywords': ['tyranny',\n",
              "   'watchdog',\n",
              "   'barricades',\n",
              "   'parliament',\n",
              "   'way',\n",
              "   'main',\n",
              "   'building',\n",
              "   'occupies',\n",
              "   'party',\n",
              "   'fighting',\n",
              "   'ruling',\n",
              "   'lawmakers',\n",
              "   'taiwan',\n",
              "   'opposition',\n",
              "   'withdraw'],\n",
              "  'Summary': 'Jun 29, 2020, 03:44PM ISTSource: TOI.inFighting erupted in Taiwan\\'s parliament on Monday as lawmakers from the ruling Democratic Progressive Party broke through barricades erected by the main opposition who had occupied it to protest against government \"tyranny\".\\nMore than 20 lawmakers blocked entry to the main chamber with chains and chairs, saying the government was trying to force through legislation and demanding the president withdraw the nomination of a close aide to a high-level watchdog.\\nLater, lawmakers from the ruling party pulled down the barricades and forced their way in.\\nThere were scuffles and shouting as the opposition party members struggled to hold their position.',\n",
              "  'Text': 'Jun 29, 2020, 03:44PM IST\\n\\nSource: TOI.in\\n\\nFighting erupted in Taiwan\\'s parliament on Monday as lawmakers from the ruling Democratic Progressive Party broke through barricades erected by the main opposition who had occupied it to protest against government \"tyranny\". More than 20 lawmakers blocked entry to the main chamber with chains and chairs, saying the government was trying to force through legislation and demanding the president withdraw the nomination of a close aide to a high-level watchdog. Later, lawmakers from the ruling party pulled down the barricades and forced their way in. There were scuffles and shouting as the opposition party members struggled to hold their position.',\n",
              "  'Title': 'Fighting in Taiwan parliament after opposition occupies building'},\n",
              " {'Keywords': ['coronavirus',\n",
              "   'man',\n",
              "   'seven',\n",
              "   'runs',\n",
              "   'reach',\n",
              "   'way',\n",
              "   'cappelloni',\n",
              "   'nana',\n",
              "   'ultramarathons',\n",
              "   'grandma',\n",
              "   'theyre',\n",
              "   'nursing',\n",
              "   'ruth',\n",
              "   'ones'],\n",
              "  'Summary': 'Jun 25, 2020, 08:06PM ISTSource: APWhile nonstop news about the effects of the coronavirus has become commonplace, so, too, have tales of kindness.\\nCorey Cappelloni ran seven ultramarathons in seven days for his 98-year-old grandmother who recently recovered from COVID-19.\\nThe long distance runner began the ultramarathons at his home in Washington D.C. and ended at the nursing home where his \"nana,\" Ruth Andres, lives in his hometown of Scranton, Pennsylvania.\\nSo I think it\\'s just a way to give back to the people who helped us along the way.\"\\nThe \"Run for Ruth Challenge\" raised more than $24,000 for the elderly who have been isolated during the coronavirus crisis.',\n",
              "  'Text': 'Jun 25, 2020, 08:06PM IST\\n\\nSource: AP\\n\\nWhile nonstop news about the effects of the coronavirus has become commonplace, so, too, have tales of kindness. Corey Cappelloni ran seven ultramarathons in seven days for his 98-year-old grandmother who recently recovered from COVID-19. \"All of a sudden I was preparing for this ultra marathon in March to being completely locked down, everybody\\'s lives were completely changed,\" said Cappelloni. \"And during this period I started calling my grandmother and talking to her. And I noticed everyday, she would become more and more afraid. She was fearful of the coronavirus. She was fearful that she wouldn\\'t see us. So I knew I had to do something to try to lift her spirits.\" The long distance runner began the ultramarathons at his home in Washington D.C. and ended at the nursing home where his \"nana,\" Ruth Andres, lives in his hometown of Scranton, Pennsylvania. \"The people who paved the way for us, everything that we have today, they made the sacrifices to get us where we are and now they\\'re the ones who are the most vulnerable,\" said Cappelloni. \"They\\'re the ones who are the most alone and scared. So I think it\\'s just a way to give back to the people who helped us along the way.\" The \"Run for Ruth Challenge\" raised more than $24,000 for the elderly who have been isolated during the coronavirus crisis. Cappelloni crossed the finish line at Allied Services Skilled Nursing & Rehab Center where his nana waved to him from her fourth story bedroom window. With a smile, Cappelloni explained, \"she always had my back and she always believed in me. So she\\'s definitely in my heart and a very special person to me.\"',\n",
              "  'Title': 'US: Man runs 7 ultramarathons to reach his grandma'},\n",
              " {'Keywords': ['administration',\n",
              "   'data',\n",
              "   'including',\n",
              "   'ties',\n",
              "   'army',\n",
              "   'states',\n",
              "   'chinese',\n",
              "   'companies',\n",
              "   'united',\n",
              "   'security',\n",
              "   'american',\n",
              "   'enlists',\n",
              "   'tiktok',\n",
              "   'lobbyists',\n",
              "   'suspicions',\n",
              "   'china',\n",
              "   'grow'],\n",
              "  'Summary': 'WASHINGTON: TikTok , the wildly popular social media app known for its viral dance and lip sync clips, has been embraced by millions of students, celebrities and young adults across the United States.\\nTikTok, which is owned by China-based ByteDance, has become the latest target in the Trump administration’s long-simmering security and economic battle with Beijing.\\nIt is now desperately trying to convince lawmakers and administration officials that its allegiance lies with the United States, not China.\\n“There’s a lot of misinformation about TikTok right now,” said Michael Beckerman, vice president and head of US Public Policy.\\nTikTok has been downloaded 2 billion times, with its biggest markets in India, the United States and Brazil, according to SensorTower.',\n",
              "  'Text': 'WASHINGTON: TikTok , the wildly popular social media app known for its viral dance and lip sync clips, has been embraced by millions of students, celebrities and young adults across the United States. But the company’s ties to China could cripple its existence.\\n\\nTikTok, which is owned by China-based ByteDance, has become the latest target in the Trump administration’s long-simmering security and economic battle with Beijing. It is now desperately trying to convince lawmakers and administration officials that its allegiance lies with the United States, not China.\\n\\nThe social media company, which one year ago had virtually no lobbying presence in the nation’s capital, has hired a small army of more than 35 lobbyists to work on its behalf, including one with deep ties to President Donald Trump.\\n\\nBehind that buildup is a growing threat to one of TikTok’s most important markets. Secretary of State Mike Pompeo has threatened to ban Chinese apps like TikTok, which are downloaded to mobile phones, over concerns they could be used for surveillance by the Chinese government . Peter Navarro, the White House trade adviser, called TikTok’s new chief executive an “American puppet” during a Fox Business interview Sunday and said the administration would take “strong action” against the company and other Chinese social media apps.\\n\\nA powerful US panel has opened a national security review into ByteDance’s 2018 purchase of Musical.ly, an app that was merged to form TikTok. The Committee on Foreign Investment in the United States is examining whether the merged companies could give the Chinese government access to vast amounts of US data, including videos useful for training facial recognition software. And the Trump administration is weighing action against Chinese social media services like TikTok under the International Emergency Economic Powers Act, which allows the president to regulate international commerce in response to unusual and extraordinary threats, people familiar with the deliberations said.\\n\\nSpeaking to reporters Wednesday evening, the White House chief of staff, Mark Meadows, said a number of administration officials were “looking at the national security risk as it relates to TikTok, WeChat and other apps.”\\n\\n“I don’t think there’s any self-imposed deadline for action, but I think we are looking at weeks, not months,” he said.\\n\\nIn the past three months, lobbyists working on behalf of TikTok have held at least 50 meetings with congressional staff and lawmakers, including those on top committees like commerce, judiciary and intelligence. Those meetings have included a slick presentation that includes an organizational chart showing TikTok does not operate in China and that most of its top leaders reside in the United States and are American citizens. For instance, TikTok’s new chief executive, Kevin Mayer, a former executive of Disney, lives in Los Angeles, they said.\\n\\nByteDance denies it shares data with the Chinese government and is distancing itself from its roots in the communist nation. The company stressed TikTok was not available in China — it offers a similar app called Douyin there instead — and said user data was stored in Virginia, with a backup in Singapore.\\n\\n“There’s a lot of misinformation about TikTok right now,” said Michael Beckerman, vice president and head of US Public Policy. “TikTok is led by an American CEO, with hundreds of employees and key leaders across safety, security, product and public policy in the US”\\n\\nBut some members of Congress still have suspicions. An aide to Sen Marco Rubio, R-Fla., who requested the CFIUS review of TikTok, said ByteDance had provided conflicting information in a meeting with representatives of Rubio’s office about where its data was stored as well as insufficient information about how it controls and censors its content.\\n\\n“It is no coincidence that every day more companies and organizations are asking employees to delete TikTok,” Rubio said in a statement, referring to moves by Wells Fargo and others to bar the app from company devices. “TikTok has yet to provide a real explanation to Americans about how they protect their data and how much of it could be made available to the Chinese Communist Party .”\\n\\nThe United States provides a crucial audience for TikTok. American influencers have global followings, and the app has become a center of conversation about politics, the pandemic and racial inequality. TikTok users claimed credit for reserving thousands of seats for Trump’s campaign rally in Tulsa, Oklahoma , last month — and then not showing up.\\n\\nBut it remains a high bar for ByteDance to convince the US government that it is not susceptible to the directives of the Chinese government. Trump and his top advisers have increasingly focused on Chinese technology companies, including Huawei and ZTE, saying those firms threaten national security by providing a conduit for the Chinese government to infiltrate US technology. The United States has already barred dozens of high-tech Chinese companies — including those specializing in supercomputers, artificial intelligence and facial recognition — from gaining access to US technology products out of national security concerns.\\n\\n“What the American people have to understand is, all the data that goes into those mobile apps that kids have so much fun with and seem so convenient, it goes right to servers in China, right to the Chinese military, the Chinese Communist Party and the agencies that want to steal our intellectual property,” Navarro said over the weekend.\\n\\nThe issue of whether TikTok should be curbed in the United States has taken on new urgency, in part because of India’s decision in late June to ban it and nearly 60 other Chinese apps, a Trump administration official said. TikTok has been downloaded 2 billion times, with its biggest markets in India, the United States and Brazil, according to SensorTower.\\n\\nIn December, the Pentagon ordered military personnel to delete the TikTok app from their phones, and some administration officials have argued that the United States should retroactively block ByteDance’s acquisition of Musical.ly, which could force the company to divest its US assets or at least make changes to the way it moves and stores data worldwide.\\n\\nThe State Department is considering expanding its so-called clean networks program to include apps as it tries to steer foreign governments away from unsecure Chinese telecommunications firms in the name of protecting Americans’ private information, according to officials familiar with the internal discussions.\\n\\nTikTok would be considered among those apps, although officials said the State Department has not yet designated companies to be included in the expansion.\\n\\n“Whether it’s TikTok or any of the other Chinese communications platforms, apps, infrastructure, this administration has taken seriously the requirement to protect the American people from having their information end up in the hands of the Chinese Communist Party,” Pompeo said Wednesday in an interview with The Hill newspaper in Washington.\\n\\nHe said he had heard from parents eager to see TikTok banned: “That’s for the parents to decide their kids’ usage on their cellphones. It’s our task to make sure that their children’s information doesn’t end up in the hands of the Chinese Communist Party.”\\n\\nOfficials have also been considering potential national security risks from other Chinese internet and social media services, including Tencent’s WeChat, which had more than 1 billion active monthly users worldwide in the first quarter of 2020.\\n\\n“These companies cannot claim that they don’t follow the orders of the party; that’s just not credible,” said Derek Scissors, a resident scholar at the American Enterprise Institute who tracks Chinese investment worldwide. “Chinese firms don’t have a choice.”\\n\\n',\n",
              "  'Title': 'TikTok enlists army of lobbyists as suspicions over China ties grow'},\n",
              " {'Keywords': ['dubious',\n",
              "   'airlines',\n",
              "   'aviation',\n",
              "   'pilots',\n",
              "   'licenses',\n",
              "   'pakistani',\n",
              "   'licences',\n",
              "   'sources',\n",
              "   'suspended',\n",
              "   'oman',\n",
              "   'pakistan',\n",
              "   'international',\n",
              "   'view',\n",
              "   'pilot',\n",
              "   'ban',\n",
              "   'scandal',\n",
              "   'pia',\n",
              "   'safety'],\n",
              "  'Summary': \"A threat of a ban on Pakistan International Airlines (PIA) flights in the airspace of Oman looms large, the media reported further.\\nAmid the aviation crisis, seven other countries including Ethiopia, Saudi Arabia and Kuwait, where Pakistani pilots had been employed with different airlines have asked Islamabad to verify their credentials.\\nMeanwhile, the commercial flying licences of 28 Pakistani pilots, who traced to have 'dubious' licences in 2018, have been cancelled.\\nOf the 262 'dubious' licence holders, 34 pilots had been suspended by the aviation division.\\nTwenty four other pilots were suspended last Saturday, while sources said 30 to 40 pilots were expected to be suspended within the next few days.\",\n",
              "  'Text': \"RAWALPINDI: Oman may become the first country to ban the Pakistan International Airlines (PIA) from using its airspace after the Omani Civil Aviation Authority expressed concern over the issue of dubious licences of Pakistani pilots and sought an explanation from Islamabad regarding curative measures undertaken to ensure flight safety, according to a report in The Dawn.\\n\\nA threat of a ban on Pakistan International Airlines (PIA) flights in the airspace of Oman looms large, the media reported further.\\n\\nEarlier, the European Union Air Safety Agency ( EUASA ) suspended PIA authorisation to operate in the EU member states for six months, while the International Air Transport Association (IATA) also shared its concern over the serious lapse in the licensing and safety oversight by the aviation regulator .\\n\\nMeanwhile, the Pakistan CAA has explained to the Omani Civil Aviation Authority that credentials of all pilots, who were allowed to fly, had been scrutinised before they had been declared fit to fly, the sources close to the matter informed The Dawn.\\n\\nThe Omani authorities were further informed that the scrutiny of pilots was initiated by the Pakistani authorities on the directive of the Supreme Court of Pakistan a couple of years ago, the sources explained.\\n\\nAmid the aviation crisis, seven other countries including Ethiopia, Saudi Arabia and Kuwait, where Pakistani pilots had been employed with different airlines have asked Islamabad to verify their credentials.\\n\\nMeanwhile, the commercial flying licences of 28 Pakistani pilots, who traced to have 'dubious' licences in 2018, have been cancelled. After legal formalities, they would be terminated from service by the airline.\\n\\nOf the 262 'dubious' licence holders, 34 pilots had been suspended by the aviation division. Twenty four other pilots were suspended last Saturday, while sources said 30 to 40 pilots were expected to be suspended within the next few days.\\n\\nThe aviation crisis in Pakistan has caught world attention after the federal Minister for Aviation Ghulam Sarwar in the National Assembly had declared that 150 pilots of the national flag carrier had been having dubious licences.\\n\\n\",\n",
              "  'Title': 'Oman may ban Pakistan International Airlines in view of dubious pilot licenses scandal'},\n",
              " {'Keywords': ['navy',\n",
              "   'coronavirus',\n",
              "   'lanka',\n",
              "   'sri',\n",
              "   'positive',\n",
              "   'dinesh',\n",
              "   'man',\n",
              "   'half',\n",
              "   'tested',\n",
              "   'virus',\n",
              "   'nearly',\n",
              "   'infected',\n",
              "   'speaks',\n",
              "   'blamed',\n",
              "   'sailors',\n",
              "   'cases'],\n",
              "  'Summary': 'Two weeks later, some sailors involved in the operation did, too.Navy spokesperson Lt. Cmdr.\\nAt least 15 villages were isolated in different parts of Sri Lanka for about two weeks, and about 1,300 other people underwent self-quarantine.Ultimately, about 900 navy sailors tested positive, with around 50 other infected people also part of that cluster.\\nTwo other clusters also blamed on Dinesh had at least 150 coronavirus cases, according to authorities.Sri Lanka has confirmed at least 2,665 cases in all, including 11 deaths, meaning nearly half of its caseload has been blamed on one man - Dinesh.\\nhe said, referring to his heroin habit.Dinesh said that he had been using heroin since 2002, but that he never became \"a severe addict.\"\\n\"I did not suffer severe withdrawals because I was not a severe addict,\" he said.',\n",
              "  'Text': 'Referring to him only as \"Patient 206,\\'\\' government officials lambasted Dinesh on TV and social media, blaming... Read More\\n\\nCOLOMBO: For months he\\'s been anonymous, but now Prasad Dinesh , linked by Sri Lankan authorities to nearly half of the country\\'s more than 2,600 coronavirus cases, is trying to clear his name, and shed some of the stigma of a heroin addiction at the root of his ordeal.Under President Gotabaya Rajapaksa , a former army lieutenant colonel credited with helping end Sri Lanka\\'s long civil war in 2009 with a brutal military campaign against separatists, the Indian Ocean island nation has used the armed forces to combat the virus.When Rajapaksa was elected president last year, a health unit was created in the intelligence service that sprang into action when COVID-19 first appeared, according to State Intelligence Service Assistant Director Parakrama de Silva. Intelligence officers, health workers, police officers and military troops have worked together to identify infected people, trace their contacts and send them to military-run quarantine centers.After Dinesh, 33, tested positive for the virus in April, navy sailors raided his village, forcing his contacts into quarantine. But authorities have blamed a melee that ensued not on the military, but on Dinesh and said the rumpus ended up leading to at least 1,100 additional virus infections.These cases, they publicly declared, were all linked linked to a single patient.Referring to him only as \"Patient 206,\\'\\' government officials lambasted Dinesh on TV and social media, blaming him for at least three clusters of cases, including about 900 navy sailors who were infected after an operation in Ja-Ela, a small town about 19 kilometers (12 miles) north of the capital, Colombo.Dinesh, however, says his drug addiction, which is considered a crime in Sri Lanka, makes him a convenient scapegoat.``I can\\'t accept that I am responsible for infecting so many, including the navy sailors,\\'\\' Dinesh told The Associated Press, after he had returned home following his release from a monthlong stay at a hospital.Before the pandemic reached Sri Lanka, resulting in an island-wide lockdown, Dinesh worked as an auto rickshaw driver. But now he\\'s unable to find work.``No one gives a job when they realize that I am Patient 206,\\'\\' he said.Likening him to South Korea\\'s ``Patient 31,\\'\\' whom media in that country labeled a ``super spreader\\'\\' because she was the first person to test positive in a secretive church community where the virus was later found endemic, police spokesman Ajith Rohana said Dinesh had undermined Sri Lanka\\'s fight against COVID-19.``He is the turning point and has done huge damage to our country,\\'\\' Rohana said.Authorities say that on April 5, Dinesh was caught by village residents for a robbery and handed over to police. At the station, Dinesh had a fever as well as a leg injury sustained during the robbery, so authorities admitted him to a nearby hospital, where he tested positive for the coronavirus and stayed for 31 days.Dinesh hasn\\'t contested charges that he and others broke into a house in a nearby village to take coconuts they could sell in order to buy heroin.After he tested positive, the police who made the arrest, Dinesh\\'s friends and more than 100 people in his neighborhood were ordered to quarantine at home.But not everyone complied.Afraid that the virus would spread quickly in the congested area, Sri Lanka\\'s navy sent in a team of sailors to help health workers. As the sailors approached, some of Dinesh\\'s associates panicked.``They were climbing trees, they were trying to jump over a fence, trying to have a bath, trying to jump into a canal,\\'\\' Adm. Jayanath Colombage , a former navy commander and member of the national task force to combat the virus, said in a TV interview.Of the 28 people seized from the community and quarantined, 16 tested positive. Two weeks later, some sailors involved in the operation did, too.Navy spokesperson Lt. Cmdr. Isuru Suriyabandara defended the navy, saying it had deployed well-trained troops with protective gear who were quarantined for 21 days after the operation.The first infected sailor, who was on leave in the town of Polonnaruwa, about 225 kilometers (140 miles) northeast of Colombo, was reported April 22, prompting provincial health officials to isolate 12 nearby villages.The next day, 30 other sailors tested positive.With the virus spreading to different parts of the country where sailors were on leave, authorities ordered troops from all arms of the military to report back to their camps.Some 4,000 navy sailors were quarantined inside a single camp, while more than 200 relatives were taken to navy-run quarantine centers. At least 15 villages were isolated in different parts of Sri Lanka for about two weeks, and about 1,300 other people underwent self-quarantine.Ultimately, about 900 navy sailors tested positive, with around 50 other infected people also part of that cluster. Two other clusters also blamed on Dinesh had at least 150 coronavirus cases, according to authorities.Sri Lanka has confirmed at least 2,665 cases in all, including 11 deaths, meaning nearly half of its caseload has been blamed on one man - Dinesh.\"What to do? It is our fault for using drugs?\" he said, referring to his heroin habit.Dinesh said that he had been using heroin since 2002, but that he never became \"a severe addict.\" During the coronavirus lockdown, however, he used the drug more regularly, and joined three other users in the robbery to raise money to buy more heroin.Former Sri Lankan President Maithripala Sirisena launched an expansive crackdown on illegal drugs, calling users \" social catastrophe,\" and his successor, Rajapaksa, also has taken a tough stance.Authorities have used the fallout from the raid on Dinesh\\'s village to increase anti-drug crackdowns in slums and urban apartments.Officials say some 300,000 people - around 1.5% of all Sri Lankans - are addicted to drugs.Dinesh, however, said he was no longer part of that stigmatized population.One positive of being infected with the coronavirus, he said, was that his hospitalization helped him to kick his heroin habit.He said he had body pains for about two days. \"I did not suffer severe withdrawals because I was not a severe addict,\" he said.\"I have now completely given up (drugs),\" he said. \"I don\\'t even smoke a cigarette. I am always with my two kids now and play with them. I feel good.\"',\n",
              "  'Title': 'Sri Lanka Coronavirus Cases: Man blamed for nearly half Sri Lanka virus cases speaks out'},\n",
              " {'Keywords': ['coronavirus',\n",
              "   'oxfordastrazeneca',\n",
              "   'positive',\n",
              "   'covid19',\n",
              "   'oxford',\n",
              "   'phase',\n",
              "   'trials',\n",
              "   'vaccine',\n",
              "   'immune',\n",
              "   'data',\n",
              "   'university',\n",
              "   'report',\n",
              "   'trial',\n",
              "   'world',\n",
              "   'come',\n",
              "   'today'],\n",
              "  'Summary': 'LONDON: Positive news on initial trials of the University of Oxford \\'s potential Covid-19 vaccine that has been licensed to AstraZeneca could be announced as soon as Thursday, ITV\\'s political editor Robert Peston said, citing a source.The potential vaccine is already in large-scale Phase III human trials to assess whether it can protect against Covid-19, but its developers have yet to report Phase I results which would show whether it is safe and whether or not it induces an immune response.The developers of the vaccine said this month they were encouraged by the immune response they had seen in trials so far and were expecting to publish Phase 1 data by the end of July.The data are expected to be published by The Lancet medical journal.More than 100 vaccines are being developed and tested around the world to try to stop the Covid-19 pandemic, which has killed hundreds of thousands and ravaged the global economy.AstraZeneca\\'s experimental vaccine is probably the world\\'s leading candidate and most advanced in terms of development, the World Health Organization \\'s chief scientist said in June.The company has signed agreements with governments around the globe to supply the vaccine should it be cleared for use.Shares in AstraZeneca traded 5% higher by 1415 GMT.\\nThere was no immediate comment from the company on the report.A spokeswoman for Oxford University told Reuters the team was awaiting confirmation from a scientific journal of a publication date and time for the data, but gave no further details.\\n\"(We) are not able to confirm when it will be released,\" she said.Peston said in a blog post: \"I am hearing there will be positive news soon (perhaps tomorrow) on initial trials of the Oxford COVID-19 vaccine that is backed by AstraZeneca.\\n\"Researchers in the United States reported on Tuesday that Moderna Inc\\'s experimental vaccine showed it was safe and provoked immune responses in all 45 healthy volunteers in an ongoing early-stage study.Moderna started its Phase II trial in May and expects to start a Phase III trial on July 27.',\n",
              "  'Text': 'LONDON: Positive news on initial trials of the University of Oxford \\'s potential Covid-19 vaccine that has been licensed to AstraZeneca could be announced as soon as Thursday, ITV\\'s political editor Robert Peston said, citing a source.The potential vaccine is already in large-scale Phase III human trials to assess whether it can protect against Covid-19, but its developers have yet to report Phase I results which would show whether it is safe and whether or not it induces an immune response.The developers of the vaccine said this month they were encouraged by the immune response they had seen in trials so far and were expecting to publish Phase 1 data by the end of July.The data are expected to be published by The Lancet medical journal.More than 100 vaccines are being developed and tested around the world to try to stop the Covid-19 pandemic, which has killed hundreds of thousands and ravaged the global economy.AstraZeneca\\'s experimental vaccine is probably the world\\'s leading candidate and most advanced in terms of development, the World Health Organization \\'s chief scientist said in June.The company has signed agreements with governments around the globe to supply the vaccine should it be cleared for use.Shares in AstraZeneca traded 5% higher by 1415 GMT. There was no immediate comment from the company on the report.A spokeswoman for Oxford University told Reuters the team was awaiting confirmation from a scientific journal of a publication date and time for the data, but gave no further details. \"(We) are not able to confirm when it will be released,\" she said.Peston said in a blog post: \"I am hearing there will be positive news soon (perhaps tomorrow) on initial trials of the Oxford COVID-19 vaccine that is backed by AstraZeneca.\"Researchers in the United States reported on Tuesday that Moderna Inc\\'s experimental vaccine showed it was safe and provoked immune responses in all 45 healthy volunteers in an ongoing early-stage study.Moderna started its Phase II trial in May and expects to start a Phase III trial on July 27.',\n",
              "  'Title': 'Oxford Coronavirus vaccine: Positive news on Oxford/AstraZeneca Covid-19 vaccine could come today: Report'},\n",
              " {'Keywords': ['putin',\n",
              "   'reforms',\n",
              "   'protesters',\n",
              "   'hundreds',\n",
              "   'old',\n",
              "   'vladimir',\n",
              "   'power',\n",
              "   'protest',\n",
              "   'vote',\n",
              "   'moscow',\n",
              "   'constitutional',\n",
              "   'president',\n",
              "   'petition'],\n",
              "  'Summary': 'MOSCOW: Dozens of people were arrested at a protest in Moscow on Wednesday against constitutional reforms that give President Vladimir Putin the option to remain in power for another 16 years, witnesses and a monitoring group said.\\nAbout 500 demonstrators, many of whom wore face masks branded with the word “no”, chanted calls for Putin to resign and held up banners against the reforms.\\n“I came here to sign the petition against the constitutional reforms because I am a nationalist,” said one 40-year old man in a black t-shirt as protesters chanted “Putin is a thief”.\\nFourteen-year old Vasilisa said she also signed the petition because Putin “is to blame for the poverty in our country”.\\nTwo Russian activists involved in the campaign against the constitutional reforms were detained last week and the homes of five others were searched, ahead of the scheduled protest, which had not been sanctioned by authorities.',\n",
              "  'Text': 'MOSCOW: Dozens of people were arrested at a protest in Moscow on Wednesday against constitutional reforms that give President Vladimir Putin the option to remain in power for another 16 years, witnesses and a monitoring group said.\\n\\nAbout 500 demonstrators, many of whom wore face masks branded with the word “no”, chanted calls for Putin to resign and held up banners against the reforms.\\n\\nPolice surrounded them and began making arrests late in the evening after participants started a march down one of the city’s main boulevards, with officers in riot gear forcefully rounding up protesters and placing them in vans.\\n\\nOver a hundred people were detained, according to the rights monitoring group OVD-info. There was no immediate confirmation from police or the government on numbers of arrests.\\n\\nA vote earlier this month amended Russia’s constitution, handing Putin the right to run for two more presidential terms, an outcome the Kremlin described as a triumph.\\n\\nOpposition activists say the vote was illegitimate and that it is time for Putin, who has ruled Russia for over two decades as president or prime minister, to step down.\\n\\n“I came here to sign the petition against the constitutional reforms because I am a nationalist,” said one 40-year old man in a black t-shirt as protesters chanted “Putin is a thief”.\\n\\nFourteen-year old Vasilisa said she also signed the petition because Putin “is to blame for the poverty in our country”.\\n\\n“Gay people are killed here, women are beaten up here, and no one is ever held accountable,” she said.\\n\\nTwo Russian activists involved in the campaign against the constitutional reforms were detained last week and the homes of five others were searched, ahead of the scheduled protest, which had not been sanctioned by authorities.\\n\\nMass gatherings are banned in the capital because of Covid-19 restrictions. Even in normal times, protests of more than one person require the authorities’ advance consent.\\n\\n',\n",
              "  'Title': 'Vladimir Putin: Hundreds protest in Moscow against reforms that may keep Putin in power'},\n",
              " {'Keywords': ['coronavirus',\n",
              "   'workers',\n",
              "   'pretest',\n",
              "   'research',\n",
              "   'vaccine',\n",
              "   'company',\n",
              "   'military',\n",
              "   'uses',\n",
              "   'testing',\n",
              "   'vaccines',\n",
              "   'firm',\n",
              "   'race',\n",
              "   'study',\n",
              "   'medical',\n",
              "   'china',\n",
              "   'global'],\n",
              "  'Summary': 'BEIJING: In the global race to make a coronavirus vaccine , a state-owned Chinese company is boasting that its employees, including top executives, received experimental shots even before the government approved testing in people.\\n\"Getting a COVID-19 vaccine is the new Holy Grail,\\'\\' said Lawrence Gostin, a global public health law expert at Georgetown University.\\nEight of the nearly two dozen potential vaccines in various stages of human testing worldwide are from China, the most of any country.\\nMore than 600,000 U.S. schoolchildren had to be given Salk\\'s vaccine or a dummy shot to prove polio protection.\\nIt took almost another decade to validate Marshall\\'s ulcer germ theory, which earned him a Nobel as well.Modern international ethics rules require participants in medical research to be fully informed and to freely consent.',\n",
              "  'Text': 'BEIJING: In the global race to make a coronavirus vaccine , a state-owned Chinese company is boasting that its employees, including top executives, received experimental shots even before the government approved testing in people.\"Giving a helping hand in forging the sword of victory,\\'\\' reads an online post from SinoPharm with pictures of workers it says helped \"pre-test\" its vaccine.Whether it\\'s viewed as heroic sacrifice or a violation of international ethical norms, the claim underscores the enormous stakes as China competes with US and British companies to be the first with a vaccine to help end the pandemic - a feat that would be both a scientific and political triumph.\"Getting a COVID-19 vaccine is the new Holy Grail,\\'\\' said Lawrence Gostin, a global public health law expert at Georgetown University. \"The political competition to be the first is no less consequential than the race for the moon between the United States and Russia.\"China has positioned itself to be a strong contender. Eight of the nearly two dozen potential vaccines in various stages of human testing worldwide are from China, the most of any country. And SinoPharm and another Chinese company already have announced they\\'re entering final testing.Both China and SinoPharm have invested heavily in a tried-and-true technology - an \"inactivated\" vaccine made by growing the whole virus in a lab and then killing it, which is how polio shots are made. Leading Western competitors use newer, less proven technology to target the \"spike\" protein that coats the virus.That protein is \"a good place to make our bet,\" Dr. Gary Nabel, chief scientific officer of the French pharmaceutical company Sanofi, said at a US biotechnology industry meeting. But \"it\\'s good to have some diversity. I like the fact that there is an inactivated, whole vaccine. That provides an alternative in case one of these should fail.\"SinoPharm\\'s claim that 30 \"special volunteers\" rolled up their sleeves even before the company got permission for its initial human study raises ethical concerns among Western observers. The company\\'s post cites a \"spirit of sacrifice\" and shows seven men in suits and ties - a mix of scientists, businessmen and one Communist Party official with a background in military propaganda.\"The idea of people willing to sacrifice themselves ... is pretty much expected in China,\\'\\' said Yanzhong Huang, a global health expert at the Council on Foreign Relations, a U.S. nonprofit organization.But with corporate and government officials getting vaccinated, other employees ``might feel pressure to participate. That would violate the voluntary principle\\'\\' that is a bedrock of modern medical ethics, Huang said.The first round of human testing - a Phase 1 trial - requires permission from a country\\'s drug regulators, who decide whether there is enough laboratory and animal evidence to justify the attempt.SinoPharm, which declined to comment for this story, is testing two vaccine candidates that received government permission for Phase 1 trials in mid- to late April. In a post on its subsidiary\\'s official WeChat account, the company says it conducted its \"pre-test\" at the end of March ``to make the vaccines hit the market as early as possible.\\'\\'It would not be the only shortcut China is taking. In late June, the government gave special approval for the military to use an experimental vaccine made by another company, CanSino Biologics, skipping the final testing needed to prove if it really works. CanSino now says it\\'s in talks with four other countries about doing that research.Some participants in the first CanSino clinical trial in March said in social media posts that researchers on the project claimed they had been injected Feb. 29, before regulators gave the study the go-ahead. A researcher said team leader Chen Wei, a renowned military virologist, was the first to receive the experimental vaccine, one of the participants told state-owned Beijing News.CanSino and Chen\\'s Academy of Military Medical Sciences turned down requests for information and interviews. The National Medical Products Administration, which approves vaccine trials, also declined to comment.In May, a Russian scientist told the RIA Novosti news agency that he and fellow researchers also had vaccinated themselves ahead of approved studies. ``It\\'s self-defense in order for us to continue working\\'\\' on a vaccine, said Alexander Gintsburg of the Moscow-based Gamaleya research institute.``Everyone is alive and well and cheerful,\\'\\' he added.Russia\\'s Association of Clinical Research Organizations condemned the action as a ``crude violation of the very foundations of clinical research, Russian law and universally accepted international regulations.\\'\\' But about a month later, Russia launched its first vaccine study, using the Gamaleya product.Examples of scientists experimenting on themselves abound in medical history.Around 1900, Pierre Curie, Marie Curie\\'s husband, deliberately burned his arm with radium as part of their radiation experiments. In the 1950s, Jonas Salk tested his ultimately successful polio vaccine on himself and his family. In the 1980s, Australia\\'s Dr. Barry Marshall drank a bacteria-laden broth as part of his quest to prove germs, not stress, cause stomach ulcers. He was right.And in China in the 1970s, a researcher named Tu Youyou, working in a secret military program, discovered an important anti-malaria drug that she first tested on herself. In 2015, she won a Nobel Prize.With a COVID-19 vaccine, national pride is at stake. President Xi Jinping pledged that any Chinese-made vaccine would be a ``global public good.\\'\\'All this is taking place as China strives to overcome years of drug scandals - the latest coming in 2018 when authorities recalled a rabies vaccine and later announced batches of children\\'s DPT vaccines, for diphtheria, pertussis and tetanus, were ineffective.Giving the experimental shot early to SinoPharm\\'s employees ``sends a signal to the Chinese people, `You guys should not worry about the safety of the vaccine,\\'\\'\\' Huang said.Scientists vehemently debate self-experimenting because what happens to one or a few people outside of a well-designed study is anecdote, not evidence. More than 600,000 U.S. schoolchildren had to be given Salk\\'s vaccine or a dummy shot to prove polio protection. It took almost another decade to validate Marshall\\'s ulcer germ theory, which earned him a Nobel as well.Modern international ethics rules require participants in medical research to be fully informed and to freely consent. In the U.S., studies involving people must receive approval from an ``investigational review board,`` and most U.S. research institutions explicitly state there is no exception to board approval for self-experimenting.``Employees may not be the best volunteers because employees are in a relationship which is not equal,\\'\\' said Dr. Derrick Au, bioethics director at the Chinese University of Hong Kong.Still, he said questions about China\\'s medical ethics might disappear if one of its COVID-19 vaccines ultimately proves to work. ``It\\'s difficult to argue against success,`` Au said.William Lee of the Milken Institute, a think tank in Santa Monica, California, that is tracking COVID-19 vaccine progress, said that because of China\\'s past scandals, ``if they are successful as being the first with a workable product on the market, it had better be so pristine, so pure that people who are outside of China would be willing to buy into it.``',\n",
              "  'Title': \"China Coronavirus Vaccine: China firm uses workers to 'pre-test' vaccine in global race\"},\n",
              " {'Keywords': ['province',\n",
              "   'soylu',\n",
              "   'mission',\n",
              "   'minister',\n",
              "   'van',\n",
              "   'turkey',\n",
              "   'iran',\n",
              "   'killing',\n",
              "   'surveillance',\n",
              "   'small',\n",
              "   'plane',\n",
              "   'eastern',\n",
              "   'crashes'],\n",
              "  'Summary': \"ANKARA: A small plane belonging to Turkey 's police force has crashed into a mountain in eastern Turkey, killing seven officers on board, Turkey's interior minister said on Thursday.\\nThe plane was returning from a surveillance and reconnaissance mission late on Wednesday, when it crashed into the Artos mountains in the eastern province of Van, near the border with Iran , Suleyman Soylu told reporters.\\nThe minister said the plane disappeared from the radar on its way back to an airport following a surveillance mission over Van and the neighbouring province of Hakkari, which lies farther south and borders both Iran and Iraq .\\nAll on board, including the two pilots, were members of the national police.\\nThe cause of the of crash was under investigation, Soylu said.\",\n",
              "  'Text': \"ANKARA: A small plane belonging to Turkey 's police force has crashed into a mountain in eastern Turkey, killing seven officers on board, Turkey's interior minister said on Thursday.\\n\\nThe plane was returning from a surveillance and reconnaissance mission late on Wednesday, when it crashed into the Artos mountains in the eastern province of Van, near the border with Iran , Suleyman Soylu told reporters.\\n\\nThe minister said the plane disappeared from the radar on its way back to an airport following a surveillance mission over Van and the neighbouring province of Hakkari, which lies farther south and borders both Iran and Iraq .\\n\\nThe plane's wreckage was found at around 3am (0000 GMT), he said.\\n\\nAll on board, including the two pilots, were members of the national police.\\n\\nThe cause of the of crash was under investigation, Soylu said.\\n\\n\",\n",
              "  'Title': 'Small police plane crashes in eastern Turkey, killing 7'},\n",
              " {'Keywords': ['helicopters',\n",
              "   'drills',\n",
              "   'missiles',\n",
              "   'usmade',\n",
              "   'potential',\n",
              "   'holds',\n",
              "   'threat',\n",
              "   'fired',\n",
              "   'world',\n",
              "   'military',\n",
              "   'taiwan',\n",
              "   'china',\n",
              "   'annual',\n",
              "   'exercise'],\n",
              "  'Summary': \"Two US-made AH-64E Apache attack helicopters release flares during the annual Han Kuang military drills in Tai... Read MoreTAICHUNG (TAIWAN): Taiwan's military fired missiles from the air and the island's shore facing China on Thursday in a live-fire exercise to demonstrate its ability to defend against any Chinese invasion.\\n“We want the world to see our determination and efforts to protect our country,” President Tsai Ing-wen said, observing the exercise in a helmet and green military uniform.\\nThe drill was part of a five-day annual exercise that ends Friday.\\nChina regards Taiwan as a breakaway province that is part of its territory.\\nThe self-governing island of 24 million people lies 160 kilometers (100 miles) off China's southeast coast across the Taiwan Strait.\",\n",
              "  'Text': \"Two US-made AH-64E Apache attack helicopters release flares during the annual Han Kuang military drills in Tai... Read More\\n\\nTAICHUNG (TAIWAN): Taiwan's military fired missiles from the air and the island's shore facing China on Thursday in a live-fire exercise to demonstrate its ability to defend against any Chinese invasion.\\n\\nAssault helicopters launched missiles and fighter jets dropped bombs on targets at sea, while tanks and missile trucks fired from a beach to deter a simulated invading force.\\n\\n“We want the world to see our determination and efforts to protect our country,” President Tsai Ing-wen said, observing the exercise in a helmet and green military uniform.\\n\\nThe drill was part of a five-day annual exercise that ends Friday. China regards Taiwan as a breakaway province that is part of its territory. The self-governing island of 24 million people lies 160 kilometers (100 miles) off China's southeast coast across the Taiwan Strait.\\n\\n\",\n",
              "  'Title': 'Taiwan holds military drills against potential China threat'},\n",
              " {'Keywords': ['work',\n",
              "   'coronavirus',\n",
              "   'workers',\n",
              "   'raincoats',\n",
              "   'bolivian',\n",
              "   'number',\n",
              "   'sex',\n",
              "   'paz',\n",
              "   'security',\n",
              "   'bet',\n",
              "   'biosecurity',\n",
              "   'organization',\n",
              "   'la',\n",
              "   'say'],\n",
              "  'Summary': 'LA PAZ: Bolivian sex workers in the capital La Paz are preparing for life in the age of the coronavirus with new equipment, including bottles of bleach, gloves and see-through raincoats, all of which they say will help them resume work safely.The thigh-skimming \"biosecurity suits\" are among a number of recommendations in a 30-page coronavirus security manual drawn up by the Organization of Night Workers of Bolivia (OTN).The group is pushing authorities to lift the day-time business restrictions put in place during the lockdowns, even if a strict nighttime curfew still impedes their more habitual evening work.Lily Cortes, a representative of Bolivia’s sex workers union, told Reuters in March that some women may have no option but to work on the streets if they could not work in cooperative-run brothels.\\nProstitution is legal in Bolivia, but procuring it is not.One sex worker, Antonieta, showed Reuters late last week how, in addition to donning a thong, a sequined eye-mask and a sheer, crotch-height dress for work, she could layer on top a paper face mask, plastic visor, gloves and a raincoat.She gave a demonstration of how she sprays a bleach solution on the pole she uses to dance for clients at the brothel that she operates with several other women.\\n\"The biosecurity suit will allow us to work and protect ourselves,\" she said.Perched on a heart-shaped leather bed in a nearby room another woman, Vanesa, a single mother to two children, said she had to work to be able to fund their studies.She said she felt confident the proposed changes would keep everyone happy.\\n\"Our clients respect the issue of safety, that we are taking these measures for our security, but also for theirs,\" she said.Bolivia has 48,187 confirmed cases of the coronavirus and 1,807 deaths, but as one of the countries where the fewest number of tests are being carried out, medical experts say the real numbers of those infected could be many times higher.The World Health Organization has said that, based on the current evidence, the coronavirus cannot be sexually transmitted.',\n",
              "  'Text': 'LA PAZ: Bolivian sex workers in the capital La Paz are preparing for life in the age of the coronavirus with new equipment, including bottles of bleach, gloves and see-through raincoats, all of which they say will help them resume work safely.The thigh-skimming \"biosecurity suits\" are among a number of recommendations in a 30-page coronavirus security manual drawn up by the Organization of Night Workers of Bolivia (OTN).The group is pushing authorities to lift the day-time business restrictions put in place during the lockdowns, even if a strict nighttime curfew still impedes their more habitual evening work.Lily Cortes, a representative of Bolivia’s sex workers union, told Reuters in March that some women may have no option but to work on the streets if they could not work in cooperative-run brothels. Prostitution is legal in Bolivia, but procuring it is not.One sex worker, Antonieta, showed Reuters late last week how, in addition to donning a thong, a sequined eye-mask and a sheer, crotch-height dress for work, she could layer on top a paper face mask, plastic visor, gloves and a raincoat.She gave a demonstration of how she sprays a bleach solution on the pole she uses to dance for clients at the brothel that she operates with several other women.\"The biosecurity suit will allow us to work and protect ourselves,\" she said.Perched on a heart-shaped leather bed in a nearby room another woman, Vanesa, a single mother to two children, said she had to work to be able to fund their studies.She said she felt confident the proposed changes would keep everyone happy. \"Our clients respect the issue of safety, that we are taking these measures for our security, but also for theirs,\" she said.Bolivia has 48,187 confirmed cases of the coronavirus and 1,807 deaths, but as one of the countries where the fewest number of tests are being carried out, medical experts say the real numbers of those infected could be many times higher.The World Health Organization has said that, based on the current evidence, the coronavirus cannot be sexually transmitted.',\n",
              "  'Title': \"Coronavirus: Bolivian sex workers bet on 'biosecurity' raincoats\"},\n",
              " {'Keywords': ['400000',\n",
              "   'dave',\n",
              "   'indianamerican',\n",
              "   'patel',\n",
              "   'victims',\n",
              "   'phone',\n",
              "   'callers',\n",
              "   'scam',\n",
              "   'indiabased',\n",
              "   'laundering',\n",
              "   'behalf',\n",
              "   'arrested',\n",
              "   'couple',\n",
              "   'money',\n",
              "   'allegedly',\n",
              "   'members',\n",
              "   'scammers'],\n",
              "  'Summary': \"WASHINGTON: An Indian-American couple has been arrested by the federal agents for allegedly laundering over $400,000 by misleading US citizens on behalf of India-based phone scammers, according to the US Department of Justice.\\nMehulkumar Manubhai Patel and Chitali Dave , both 36, allegedly laundered over $400,000 between May 2019 and January 2020 sent by at least 24 victims trapped in the scam, it said on Tuesday.The couple was on June 9 charged by a federal grand jury with money laundering conspiracy and money laundering.\\nPatel and Dave were arraigned on June19 and on July 14.“Criminal India-based call centers sought to prey on vulnerable members of our community and steal from them by misleading them over the phone,” US Attorney Byung J “BJay” Pak said.“Those, like Patel and Dave, who allegedly launder money in the United States on behalf of foreign-based fraudsters, are the linchpins of those schemes,” he added.Federal prosecutors alleged that as part of their social security scam, India-based callers pose as federal agents in order to mislead victims into believing their Social Security numbers were involved in crimes.Callers threatened arrest and the loss of the victims' assets if the victims did not send money.The callers directed victims to mail cash to aliases used by other members of the fraud network, including Patel and Dave.As part of the tech support scam, callers allegedly induced victims to send money in exchange for supposed technical support for their computers.\\nThe callers then provided nothing in return, the statement said.At times, callers misled the victims into providing remote access to their computers and the callers would access the victims' bank accounts.The callers routinely misled the victims by making it appear as though the caller added money to the victims' bank accounts.The callers then instructed the victims to mail cash to aliases used by other members of the fraud network, including Patel and Dave, the statement said.\",\n",
              "  'Text': \"WASHINGTON: An Indian-American couple has been arrested by the federal agents for allegedly laundering over $400,000 by misleading US citizens on behalf of India-based phone scammers, according to the US Department of Justice. Mehulkumar Manubhai Patel and Chitali Dave , both 36, allegedly laundered over $400,000 between May 2019 and January 2020 sent by at least 24 victims trapped in the scam, it said on Tuesday.The couple was on June 9 charged by a federal grand jury with money laundering conspiracy and money laundering. Patel and Dave were arraigned on June19 and on July 14.“Criminal India-based call centers sought to prey on vulnerable members of our community and steal from them by misleading them over the phone,” US Attorney Byung J “BJay” Pak said.“Those, like Patel and Dave, who allegedly launder money in the United States on behalf of foreign-based fraudsters, are the linchpins of those schemes,” he added.Federal prosecutors alleged that as part of their social security scam, India-based callers pose as federal agents in order to mislead victims into believing their Social Security numbers were involved in crimes.Callers threatened arrest and the loss of the victims' assets if the victims did not send money.The callers directed victims to mail cash to aliases used by other members of the fraud network, including Patel and Dave.As part of the tech support scam, callers allegedly induced victims to send money in exchange for supposed technical support for their computers. The callers then provided nothing in return, the statement said.At times, callers misled the victims into providing remote access to their computers and the callers would access the victims' bank accounts.The callers routinely misled the victims by making it appear as though the caller added money to the victims' bank accounts.The callers then instructed the victims to mail cash to aliases used by other members of the fraud network, including Patel and Dave, the statement said.\",\n",
              "  'Title': 'Indian-American couple arrested for laundering over $400,000 on behalf of phone scammers'},\n",
              " {'Keywords': ['residents',\n",
              "   'kashmiri',\n",
              "   'valley',\n",
              "   'covid19',\n",
              "   'wear',\n",
              "   'professionals',\n",
              "   'britain',\n",
              "   'follow',\n",
              "   'urged',\n",
              "   'social',\n",
              "   'medical',\n",
              "   'spread',\n",
              "   'urge',\n",
              "   'doctors',\n",
              "   'cases',\n",
              "   'kashmir',\n",
              "   'working'],\n",
              "  'Summary': '\"The British healthcare is renowned the world over but we have battled the pandemic with great difficulty.\\nThere has been a huge loss of life in Britain and neighbouring countries.\\nWe are worried for you as the infection is spreading in Kashmir.\\n\"Countries have prevented the spread of this disease by imposing lockdown and observing social distancing.\\nWe appeal to our Kashmiri brothers and sisters to reduce social contacts and take precautions as we are in a critical phase of the pandemic.',\n",
              "  'Text': 'SRINAGAR: Doctors from Kashmir working in Britain have appealed to the people of the Valley to cooperate with the medical professionals by following their advice to overcome the coronavirus pandemic.Concerned over the sudden rise in number of COVID-19 cases in the valley, top doctors of the British Kashmiri Medical Association (BKMA) in a video in Kashmiri language urged the people to follow the standard operating procedures to curb the spread of the infection.\"The British healthcare is renowned the world over but we have battled the pandemic with great difficulty. There has been a huge loss of life in Britain and neighbouring countries. We are worried for you as the infection is spreading in Kashmir. The people and healthcare experts have to fight it together,\" BKMA president Dr Farooq A Wandroo, Consultant Hematology, said in the nearly seven-minute video.Dr Shaheen Shora urged the Kashmiris to wear face masks and avoid visiting mosques.\"Please wear face masks as it reduces the chances of contracting infections. Gatherings should be avoided while prayers should be offered at home,\" she added.Dr Shariq Lankar, a general practitioner, said as there was no vaccine or medicine available to cure the coronovirus infection,Â minimizing social contact and following other SOPs were key in this fight.\"Countries have prevented the spread of this disease by imposing lockdown and observing social distancing. We appeal to our Kashmiri brothers and sisters to reduce social contacts and take precautions as we are in a critical phase of the pandemic. It is in the community and it can spread,\" Lankar said.According to the figures issued by the Jammu and Kashmir administration on Monday evening, there have been 8,495 COVID-19 cases, including 170 deaths linked to the disease, in the valley. While 4,569 patients have recovered,Â 3,756 COVID-19 cases were still active in Kashmir.While urging people to take care of people suffering from other medical conditions such as diabetes, kidney ailments and hypertension, the medical professionals appealed to the community not to discriminate against those who had contracted the infection.',\n",
              "  'Title': 'Kashmiri doctors working in Britain urge Valley residents to follow advice of medical professionals'},\n",
              " {'Keywords': ['patient',\n",
              "   'surgery',\n",
              "   'covid19',\n",
              "   'surgeons',\n",
              "   'doctor',\n",
              "   'indianorigin',\n",
              "   'led',\n",
              "   'transplant',\n",
              "   'second',\n",
              "   'doublelung',\n",
              "   'performed',\n",
              "   'hospital',\n",
              "   'dr',\n",
              "   'double',\n",
              "   'northwestern',\n",
              "   'lung',\n",
              "   'perform'],\n",
              "  'Summary': '\"Performing back to back lung transplants on such complex patients is demanding work and I\\'m extremely proud of our team\\'s dedication.\\n\"Prior to his arrival at Northwestern Memorial, the patient developed an invasive infection which required a major chest surgery.\\nThis was going to make the double-lung transplant substantially more difficult,\" says Samuel Kim, MD, Northwestern Medicine thoracic surgeon, who assisted in the double-lung transplant alongside Dr Bharat.\\n\"Our first patient continues to recover at an optimal pace,\" says Rade Tomic , MD, a pulmonologist and medical director of the Lung Transplant Programme.\\n\"Our second patient is already off the ventilator and is talking to his family.',\n",
              "  'Text': 'Dr. Ankit Bharat, chief of thoracic surgery at Northwestern Memorial Hospital (AP)\\n\\nNEW YORK: Surgeons led by an Indian-origin doctor have performed a double-lung transplant on a second patient whose lungs were damaged by Covid-19 , within a month after the same team conducted what is believed to have been the first such surgery in the US.The patient, an Illinois man in his 60s, spent 100 days on extracorporeal membrane oxygenation (ECMO), a life support machine that does the work of the heart and lungs.He received the transplant last weekend at Northwestern Memorial Hospital in Chicago, the hospital said in a statement.\"This procedure capped an extremely busy holiday weekend for our transplant team. We worked around the clock, performing multiple transplants on non-Covid patients before accepting new lungs for this Covid-19 survivor,\" said Dr Ankit Bharat, chief of thoracic surgery and surgical director of the Northwestern Medicine Lung Transplant Programme, who performed seven lung transplants in seven days.\"Performing back to back lung transplants on such complex patients is demanding work and I\\'m extremely proud of our team\\'s dedication. It\\'s a testament to the infrastructure and expertise of Northwestern Medicine\\'s Lung Transplant Programme,\" the Meerut-born doctor said.The patient contracted Covid-19 in late March and received the majority of his treatment at another health system before being transferred to Northwestern Memorial Hospital for consideration of a double-lung transplant.Within 72 hours of being listed, the life-saving procedure was performed on July 4.Before the patient\\'s name was added to the transplant wait-list, he had to test negative for Covid-19.\"Coincidentally, the transplant happened to be on the 100th day of ECMO support. Being on ECMO and separated from the ventilator allowed the patient to participate in daily bedside rehabilitation which is important for lung transplantation ,\" said Dr Bharat.Typically, a double-lung transplant takes 6 to 7 hours, but this surgery took about 10 hours due to lung necrosis and severe inflammation in the chest cavities resulting from Covid-19.\"Prior to his arrival at Northwestern Memorial, the patient developed an invasive infection which required a major chest surgery. This was going to make the double-lung transplant substantially more difficult,\" says Samuel Kim, MD, Northwestern Medicine thoracic surgeon, who assisted in the double-lung transplant alongside Dr Bharat.\"His lung damage was among the worst I\\'ve ever seen. When we opened the chest cavity there was a lot of evidence of infection; everything we touched or dissected started bleeding and one misstep could have led to catastrophic consequences.\"Northwestern surgeons led by Dr Bharat in June have performed what is believed to have been the first-known lung transplant on a Covid-19 patient in the US last month -- on a woman in her 20s.The surgeons performed their first on a woman in her 20s whose lungs showed irreversible damage from the virus.She became the first known Covid-19 patient in the United States to receive a double-lung transplant.\"Our first patient continues to recover at an optimal pace,\" says Rade Tomic , MD, a pulmonologist and medical director of the Lung Transplant Programme.\"Our second patient is already off the ventilator and is talking to his family. He\\'s grateful for the care he received from all the health care providers, including those at his original hospital, who helped him get to this point. We\\'re optimistic that both patients will make a full recovery and return to their daily lives.\"',\n",
              "  'Title': 'Surgeons led by Indian-origin doctor perform double lung transplant on second Covid-19 patient'},\n",
              " {'Keywords': ['consecutive',\n",
              "   'indianamerican',\n",
              "   'trump',\n",
              "   'elected',\n",
              "   'rnc',\n",
              "   'delegate',\n",
              "   'republican',\n",
              "   'gop',\n",
              "   'fifth',\n",
              "   'convention',\n",
              "   'president',\n",
              "   'shivangi',\n",
              "   'nominate'],\n",
              "  'Summary': '\"This convention and the upcoming presidential election is going to be historic for our nation, possibly for India and to the whole world.\\nIn 2008, he was elected as a Republican delegate at Minneapolis to nominate John McCain and in 2012 at Tampa, to nominate Mitt Romney.In 2016, Shivangi attended the RNC convention in Cleveland , Ohio as a delegate to nominate and elect the current President, Donald Trump.\\n\"It is a great honour to be a part of this historic convention to re-nominate and re-elect Trump for another four years,\" he said.\\n\"Under President Trump, the United States has made unprecedented progress.\\nAnd to top it all, under President Trump, India and Indian-Americans have the best ever friend in the White House ,\" Shivangi said.',\n",
              "  'Text': 'Sampat Shivangi (File photo)\\n\\nWASHINGTON: An Indian-American has been elected as a Republican delegate for the fifth consecutive term to the party\\'s August convention in Florida that would formally nominate President Donald Trump as its candidate for the November presidential elections.The Republican National Convention (RNC) in Jacksonville , Florida is scheduled to be held from August 24 to August 27.Dr Sampat Shivangi , the national president of Indian-American Forum for Political Education and a long-time Republican leader, has been elected to the RNC for the fifth consecutive time.\"This convention and the upcoming presidential election is going to be historic for our nation, possibly for India and to the whole world. I am glad that I can contribute a little, to my beliefs in nation building,\" he said in a statement on Friday.\"This is my fifth time to be part of the RNC delegation to nominate and help to elect our next President of USA,\" Shivangi said.The Indian-American physician was first elected as a delegate at the Republican convention in New York City in 2004, to nominate President George W Bush. In 2008, he was elected as a Republican delegate at Minneapolis to nominate John McCain and in 2012 at Tampa, to nominate Mitt Romney.In 2016, Shivangi attended the RNC convention in Cleveland , Ohio as a delegate to nominate and elect the current President, Donald Trump.\"It is a great honour to be a part of this historic convention to re-nominate and re-elect Trump for another four years,\" he said.\"Under President Trump, the United States has made unprecedented progress. Until, we were hit by coronavirus, the US economy was at an all time best. And to top it all, under President Trump, India and Indian-Americans have the best ever friend in the White House ,\" Shivangi said.',\n",
              "  'Title': 'Indian-American elected delegate to GOP convention for fifth consecutive time'},\n",
              " {'Keywords': ['trust',\n",
              "   'misappropriating',\n",
              "   'ipads',\n",
              "   'policewoman',\n",
              "   'indianorigin',\n",
              "   'times',\n",
              "   'policeissued',\n",
              "   'sentenced',\n",
              "   'public',\n",
              "   'pawned',\n",
              "   'sgd',\n",
              "   'singapore',\n",
              "   'later'],\n",
              "  'Summary': \"Representative imageSINGAPORE: An Indian-origin policewoman in Singapore was sentenced to seven months in jail on Monday for criminal breach of trust for misappropriating two police-issued ipads by pawning them at a shop.Hemavathy Gunasekaran, 37, pawned the two police-issued iPads worth more than SGD 900 ($646) at a shop for which she received SGD 300 ($215) in return, the court heard.The devices were later resold to other people when she did not redeem them, The Straits Times reported.Following a trial, District Judge Salina Ishak had found her guilty of the offence last month.Gunasekaran, who held the rank of Sergeant 2, joined the Singapore Police Force (SPF) in 2005 and was deployed to the Marina Bay Neighbourhood Police Centre (NPC) four years later.Her duties included conducting house visits to educate the public on SGSecure, Singapore's community response to the terrorism threat.Deputy Public Prosecutor Foo Shi Hao said in his submissions that at times, such duties involved the use of two SPF-issued iPads, which her colleagues handed to her in November 2016.The DPP added that the policewoman misappropriated the devices on December 8 that year and pawned them for SGD 300 at a Jurong West mobile phone shop.The iPads were later found missing at her workplace and one of her superiors, Assistant Superintendent Tam Chin Kong, repeatedly asked her to look for them in early September 2017, the report said.Tam later filed a police report.For criminal breach of trust as a public servant, Gunasekaran could have been jailed for up to 20 years and fined.\",\n",
              "  'Text': \"Representative image\\n\\nSINGAPORE: An Indian-origin policewoman in Singapore was sentenced to seven months in jail on Monday for criminal breach of trust for misappropriating two police-issued ipads by pawning them at a shop.Hemavathy Gunasekaran, 37, pawned the two police-issued iPads worth more than SGD 900 ($646) at a shop for which she received SGD 300 ($215) in return, the court heard.The devices were later resold to other people when she did not redeem them, The Straits Times reported.Following a trial, District Judge Salina Ishak had found her guilty of the offence last month.Gunasekaran, who held the rank of Sergeant 2, joined the Singapore Police Force (SPF) in 2005 and was deployed to the Marina Bay Neighbourhood Police Centre (NPC) four years later.Her duties included conducting house visits to educate the public on SGSecure, Singapore's community response to the terrorism threat.Deputy Public Prosecutor Foo Shi Hao said in his submissions that at times, such duties involved the use of two SPF-issued iPads, which her colleagues handed to her in November 2016.The DPP added that the policewoman misappropriated the devices on December 8 that year and pawned them for SGD 300 at a Jurong West mobile phone shop.The iPads were later found missing at her workplace and one of her superiors, Assistant Superintendent Tam Chin Kong, repeatedly asked her to look for them in early September 2017, the report said.Tam later filed a police report.For criminal breach of trust as a public servant, Gunasekaran could have been jailed for up to 20 years and fined.\",\n",
              "  'Title': 'Indian-origin policewoman in Singapore sentenced for misappropriating ipads'},\n",
              " {'Keywords': ['help',\n",
              "   'business',\n",
              "   'virginia',\n",
              "   'challa',\n",
              "   'indianorigin',\n",
              "   'appointed',\n",
              "   'report',\n",
              "   'businesses',\n",
              "   'study',\n",
              "   'small',\n",
              "   'commission',\n",
              "   'jayanth',\n",
              "   'working'],\n",
              "  'Summary': 'Jayanth ChallaHYDERABAD: The Virginia governor has appointed Indian origin Jayanth Challa to the Small Business Commission in the state.\\nThe Small Business Commission exists to study, report, and make recommendations on issues of concern to small businesses in the state.Challa is a Virginia resident since 1988 and currently lives in Vienna.\\nHe has a 30-year career working for information technology and engineering consulting companies.He is currently the president of Ace Info Solutions (AceInfo), a Dovel Technologies company, based out of Reston, Virginia.\\nChalla began his career as a staff engineer working on military family housing projects in Germany and Guantanamo Bay , Cuba.Speaking to TOI, Challa said, \"As part of the small business commission, I will be able to work with Virginia legislators, senators and delegates to study, report, and make recommendations on issues of concern to about 800,000 small businesses in the Commonwealth of Virginia.\\nI will try to help Telugu and Indian IT small businesses in policies such as lower taxes, business incentives and investment into research and development.',\n",
              "  'Text': 'Jayanth Challa\\n\\nHYDERABAD: The Virginia governor has appointed Indian origin Jayanth Challa to the Small Business Commission in the state. The Small Business Commission exists to study, report, and make recommendations on issues of concern to small businesses in the state.Challa is a Virginia resident since 1988 and currently lives in Vienna. He has a 30-year career working for information technology and engineering consulting companies.He is currently the president of Ace Info Solutions (AceInfo), a Dovel Technologies company, based out of Reston, Virginia. Challa began his career as a staff engineer working on military family housing projects in Germany and Guantanamo Bay , Cuba.Speaking to TOI, Challa said, \"As part of the small business commission, I will be able to work with Virginia legislators, senators and delegates to study, report, and make recommendations on issues of concern to about 800,000 small businesses in the Commonwealth of Virginia. I will try to help Telugu and Indian IT small businesses in policies such as lower taxes, business incentives and investment into research and development.\"\"Great organisations don’t see people as a commodity to be managed to help grow their money, they think of money as a commodity to be managed to help grow their people\", he added.',\n",
              "  'Title': 'Indian-origin Jayanth Challa appointed to Small Business Commission of Virginia'},\n",
              " {'Keywords': ['winner',\n",
              "   'honourees',\n",
              "   'raj',\n",
              "   'corporation',\n",
              "   'covid19',\n",
              "   'mukherjee',\n",
              "   'pulitzer',\n",
              "   'great',\n",
              "   'siddhartha',\n",
              "   'immigrants',\n",
              "   'public',\n",
              "   'york',\n",
              "   'health',\n",
              "   'social',\n",
              "   'carnegie',\n",
              "   'prof',\n",
              "   'chetty'],\n",
              "  'Summary': 'This tool enables policy makers to make evidence-based decisions that balance vital public health priorities with the economic needs of their communities, it said.\\n\"For us and many immigrants, that\\'s what America\\'s all about.\\nIf you work hard, you can move up, you can do whatever you want.\\n\"Great immigrants have come from different backgrounds and have pursued different worthwhile goals.\\nBut collectively, they have shared a desire to become citizens and have made our democratic society stronger.',\n",
              "  'Text': 'NEW YORK: Two renowned Indian-Americans who have contributed towards the efforts in mitigating the Covid-19 health crisis are among the 38 immigrants honoured by a prestigious American foundation ahead of US Independence Day commemoration this year.Pulitzer Prize-winning author and oncologist Siddhartha Mukherjee, and Professor of Economics at Harvard University Raj Chetty have been named by the Carnegie Corporation of New York as \\'2020 Great Immigrants\\' honourees, the Corporation said in a statement on Wednesday.Born in New Delhi, Mukherjee is a noted biologist, oncologist and the author of several acclaimed books, including the Pulitzer Prize-winning \\'The Emperor of All Maladies: A Biography of Cancer\\'.Since 2009, he has served on the faculty of Columbia University, where he is associate professor of medicine and a practising physician at New York-Presbyterian Hospital. In 2014, Mukherjee was awarded the Padma Shri , one of India\\'s highest civilian honours.The Carnegie Corporation said that during the Covid-19 pandemic, Mukherjee has used his \"gifts as a science communicator\" to educate the public about the virus through essays, in media interviews, at public forums, as well as through his social media accounts.Mukherjee has stressed the importance of following guidelines to social distance, wear masks and to self-isolate when necessary, it said.In May, he was selected by New York Governor Andrew Cuomo to serve on a 15-member Blue-Ribbon Commission focusing on improving telehealth and broadband access in response to the Covid-19 health crisis.Raj Chetty, who was born in New Delhi, has been one of the youngest professors to be granted tenure in Harvard\\'s history.In addition to his position as the William A. Ackman Professor of Economics at Harvard University, Chetty directs Opportunity Insights, a research lab that aims to identify barriers to economic and social mobility and develop scalable policy solutions to overcome them, the Corporation said.He helped launch a resource to monitor the real-time economic impact of Covid-19 on people, businesses and communities across the United States. This tool enables policy makers to make evidence-based decisions that balance vital public health priorities with the economic needs of their communities, it said.\"Chetty is optimistic about the potential of big data to inform policy and revive the American dream for the next generation, including immigrants -- like his own family -- who have long pinned their hopes on its promise,\" the corporation said.\"For us and many immigrants, that\\'s what America\\'s all about. If you work hard, you can move up, you can do whatever you want. The sky\\'s the limit,” the Corporation quoted Chetty as telling the Harvard Gazette Every July 4, when America celebrates its Independence Day, the Carnegie Corporation honours the legacy of its founder Andrew Carnegie, a Scottish immigrant who rose from poverty to become a leading industrialist, by recognizing an eminent group of immigrants who have made notable contributions to the progress of the American society.In 2020, the corporation honours 38 naturalized citizens \"who have enriched and strengthened our nation and our democracy through their contributions and actions,\" it said.\"Great immigrants have come from different backgrounds and have pursued different worthwhile goals. But collectively, they have shared a desire to become citizens and have made our democratic society stronger. For all of their efforts, we salute them,\" president of Carnegie Corporation of New York Vartan Gregorian said.The corporation said a third of this year\\'s honorees are helping the global health crisis recovery efforts by serving as nurses and doctors, as well as scientists who are striving to find effective treatments and a vaccine for Covid-19.Clergy and community leaders who are providing food and vital services to those in need are also among those being honoured.Overall, the \\'2020 Great Immigrants\\' represent 35 countries of origin and a wide range of contributions to American life, from human rights and computer science to art, business, education, health care, journalism, music, politics, religion, research, and sports.The 2020 honorees, who join more than 600 outstanding immigrants honoured by the Corporation since 2006, are recognized with a full-page public service announcement in the New York Times and a social media tribute on the Fourth of July.',\n",
              "  'Title': \"Pulitzer winner Siddhartha Mukherjee, Prof Raj Chetty among '2020 Great Immigrants' honourees\"},\n",
              " {'Keywords': ['white',\n",
              "   'india',\n",
              "   'indianamerican',\n",
              "   'trump',\n",
              "   'values',\n",
              "   'support',\n",
              "   'guilfoyle',\n",
              "   'donald',\n",
              "   'indianamericans',\n",
              "   'house',\n",
              "   'survey',\n",
              "   'president',\n",
              "   'grateful'],\n",
              "  'Summary': 'Donald TrumpWASHINGTON: US President Donald Trump is “Incredibly grateful” for the \"widespread support\" he has received from the people of India and Indian-Americans, the White House has said in response to a survey suggesting that over 50 per cent of the community members in some key battleground American states are switching over to him in the presidential election in November.White House Deputy Press Secretary Sarah Matthews made the comments while responding to a question on a recent survey results that Indian-Americans, who traditionally vote for the Democratic Party, are switching towards Trump, a Republican, in the November 3 election.Trump is seeking re-election to the White House in the November 3 presidential elections.“President Trump is incredibly grateful for the widespread support he has received from the people of India and from millions of Indian-Americans across the United States,” Matthews told PTI.According to the survey results conducted by Al Mason, co-chair of the Trump Victory Indian-American Finance Committee, more than 50 per cent of Indian-Americans in the battle ground states of Michigan , Florida, Texas, Pennsylvania and Virginia are crossing over to support Trump.During his more than three and half years of his presidency, Trump has made an extra effort to reach out to the Indian-American community.\\nHis close relationship with Prime Minister Narendra Modi – reflected in the two leaders jointly addressing massive public rallies in Houston and Ahmedabad – has helped him make deep inroads among the Indian-Americans.“He (Trump) recognises the vital role Indian-Americans play in bolstering our economy, enriching our culture, and strengthening our communities,” she said.During his first two years in office, President Trump led the US to its greatest economic comeback in history.“And the unemployment rate among Indian-Americans dropped by nearly 33 per cent,” Matthews said.The President continues to fight for the prosperity, health, and freedom of all Americans, including the flourishing and hardworking Indian-American community, she said, responding to a question related to the increasing popularity of Trump among the community.Al Mason said while the vision of Trump is the driving force in this unprecedented outreach with the Indian-Americans and a new peak in ties with India, the entire family including the First Lady Melania Trump , Ivanka Trump and Jared Kushner, who have recently visited India with him, shown their immense respect and love for the country.Not to overlook son Donald Trump Jr and Kimberly Guilfoyle , senior advisor to Donald Trump for President, Inc. and national chair of the Trump Victory Finance Committee, Mason said.Former TV host-cum-attorney Guilfoyle is now considered as one of the most powerful individuals in the Trump campaign.Both Trump Jr and Guilfoyle have time and again echoed Trump\\'s love for India and Indian-Americans which is reflected in their remarks at various Indian-American events in New York.\\n\"Want to see America work with incredible allies like India to make the world a safer place,” Don Jr said last year.\\n\"America embodies family values, values of hardworking people, strong work ethic, entrepreneurial spirit and these values are \"shared magnificently with India as well,” said Guilfoyle, who believes that Indian-Americans are a crucial ally for the campaign.\\n\"I think we\\'re so lucky as a country to have so many talented, dedicated, patriotic Indian-Americans making up the incredibly diverse fabric culturally of this country and we\\'re lucky that they have called it their home,” Guilfoyle, who has helped initiate the process, said.',\n",
              "  'Text': 'Donald Trump\\n\\nWASHINGTON: US President Donald Trump is “Incredibly grateful” for the \"widespread support\" he has received from the people of India and Indian-Americans, the White House has said in response to a survey suggesting that over 50 per cent of the community members in some key battleground American states are switching over to him in the presidential election in November.White House Deputy Press Secretary Sarah Matthews made the comments while responding to a question on a recent survey results that Indian-Americans, who traditionally vote for the Democratic Party, are switching towards Trump, a Republican, in the November 3 election.Trump is seeking re-election to the White House in the November 3 presidential elections.“President Trump is incredibly grateful for the widespread support he has received from the people of India and from millions of Indian-Americans across the United States,” Matthews told PTI.According to the survey results conducted by Al Mason, co-chair of the Trump Victory Indian-American Finance Committee, more than 50 per cent of Indian-Americans in the battle ground states of Michigan , Florida, Texas, Pennsylvania and Virginia are crossing over to support Trump.During his more than three and half years of his presidency, Trump has made an extra effort to reach out to the Indian-American community. His close relationship with Prime Minister Narendra Modi – reflected in the two leaders jointly addressing massive public rallies in Houston and Ahmedabad – has helped him make deep inroads among the Indian-Americans.“He (Trump) recognises the vital role Indian-Americans play in bolstering our economy, enriching our culture, and strengthening our communities,” she said.During his first two years in office, President Trump led the US to its greatest economic comeback in history.“And the unemployment rate among Indian-Americans dropped by nearly 33 per cent,” Matthews said.The President continues to fight for the prosperity, health, and freedom of all Americans, including the flourishing and hardworking Indian-American community, she said, responding to a question related to the increasing popularity of Trump among the community.Al Mason said while the vision of Trump is the driving force in this unprecedented outreach with the Indian-Americans and a new peak in ties with India, the entire family including the First Lady Melania Trump , Ivanka Trump and Jared Kushner, who have recently visited India with him, shown their immense respect and love for the country.Not to overlook son Donald Trump Jr and Kimberly Guilfoyle , senior advisor to Donald Trump for President, Inc. and national chair of the Trump Victory Finance Committee, Mason said.Former TV host-cum-attorney Guilfoyle is now considered as one of the most powerful individuals in the Trump campaign.Both Trump Jr and Guilfoyle have time and again echoed Trump\\'s love for India and Indian-Americans which is reflected in their remarks at various Indian-American events in New York.\"Want to see America work with incredible allies like India to make the world a safer place,” Don Jr said last year.\"America embodies family values, values of hardworking people, strong work ethic, entrepreneurial spirit and these values are \"shared magnificently with India as well,” said Guilfoyle, who believes that Indian-Americans are a crucial ally for the campaign.\"I think we\\'re so lucky as a country to have so many talented, dedicated, patriotic Indian-Americans making up the incredibly diverse fabric culturally of this country and we\\'re lucky that they have called it their home,” Guilfoyle, who has helped initiate the process, said.',\n",
              "  'Title': \"Donald Trump grateful for Indian-Americans' support: White House\"},\n",
              " {'Keywords': ['aide',\n",
              "   'noida',\n",
              "   'uttar',\n",
              "   'gangster',\n",
              "   'case',\n",
              "   'gajendra',\n",
              "   'worked',\n",
              "   'stf',\n",
              "   'special',\n",
              "   'mumbai',\n",
              "   'khan',\n",
              "   'businessman',\n",
              "   'salems',\n",
              "   'arrested',\n",
              "   'singh',\n",
              "   'force',\n",
              "   'task'],\n",
              "  'Summary': 'Jul 16, 2020, 11:40AM ISTSource: Times NowA key aide of 1993 Mumbai blasts case convict Abu Salem who worked in his illegal property business in NCT of Delhi has been arrested by the Special Task Force (STF) of the Uttar Pradesh police, officials said on Thursday.\\nGajendra Singh, who was also close to gangster Khan Mubarak, was nabbed in Mumbai late Wednesday night by the Noida unit of the STF, they said.\\n\"Gajendra Singh had taken Rs 1.80 crore from a Delhi-based businessman in 2014 in a property-related case.\\nWhen he was pressured to return the money, Singh had Khan Mubarak\\'s shooters open fire at the businessman in sector 18 of Noida,\" additional superintendent of police, STF, Raj Kumar Mishra said.',\n",
              "  'Text': 'Jul 16, 2020, 11:40AM IST\\n\\nSource: Times Now\\n\\nA key aide of 1993 Mumbai blasts case convict Abu Salem who worked in his illegal property business in NCT of Delhi has been arrested by the Special Task Force (STF) of the Uttar Pradesh police, officials said on Thursday. Gajendra Singh, who was also close to gangster Khan Mubarak, was nabbed in Mumbai late Wednesday night by the Noida unit of the STF, they said. \"Gajendra Singh had taken Rs 1.80 crore from a Delhi-based businessman in 2014 in a property-related case. When he was pressured to return the money, Singh had Khan Mubarak\\'s shooters open fire at the businessman in sector 18 of Noida,\" additional superintendent of police, STF, Raj Kumar Mishra said.',\n",
              "  'Title': \"Gangster Abu Salem's aide Gajendra Singh arrested by Special Task Force from Noida\"},\n",
              " {'Keywords': ['tribute',\n",
              "   'pool',\n",
              "   'days',\n",
              "   'tell',\n",
              "   'eyeballs',\n",
              "   'throwback',\n",
              "   'tie',\n",
              "   'beautiful',\n",
              "   'great',\n",
              "   'gives',\n",
              "   'visibly',\n",
              "   'ileana',\n",
              "   'grabs',\n",
              "   'season',\n",
              "   'bikini',\n",
              "   'toasted'],\n",
              "  'Summary': \"Bikini season is officially here!\\nSo, in memory of her beach baby days, actress Ileana D'Cruz shared a tribute to the good ol' days.\\nDonning a beautiful tie and dye bikini, a visibly tanned Ileana is seen sunbathing by the pool.\\nAnd let us tell you, the bikini did justice to her beautiful curves.\\nHer holiday blue caption was as follows, 'Tb to when pool days and getting gloriously toasted in the sun was no big deal.'\",\n",
              "  'Text': \"Bikini season is officially here! But the novel coronavirus pandemic has put a damper on everyone's plans, especially for our Bollywood celebrities, who, in the previous years, would jet off to exotic islands for some sun and tan. So, in memory of her beach baby days, actress Ileana D'Cruz shared a tribute to the good ol' days. Donning a beautiful tie and dye bikini, a visibly tanned Ileana is seen sunbathing by the pool. And let us tell you, the bikini did justice to her beautiful curves. Her holiday blue caption was as follows, 'Tb to when pool days and getting gloriously toasted in the sun was no big deal.'\",\n",
              "  'Title': \"Ileana D'Cruz gives tribute to bikini season with great throwback clicks, grabs eyeballs in a tie and dye bikini\"},\n",
              " {'Keywords': ['probe',\n",
              "   'inquiry',\n",
              "   'case',\n",
              "   'modi',\n",
              "   'wrote',\n",
              "   'rajputs',\n",
              "   'writes',\n",
              "   'narendra',\n",
              "   'world',\n",
              "   'subramanian',\n",
              "   'public',\n",
              "   'cbi',\n",
              "   'young',\n",
              "   'sushant',\n",
              "   'requesting',\n",
              "   'swamy',\n",
              "   'singh',\n",
              "   'written'],\n",
              "  'Summary': \"At a time when fans and many personalities from the film fraternity have been demanding CBI inquiry in Sushant Singh Rajput's death case, now BJP MP Subramanian Swamy has written to PM Narendra Modi requesting a CBI probe into the case.\\nIn his letter, Swamy wrote, “I urge you... that you may consider advising the chief minister of Maharashtra directly or through the Governor to agree to a CBI inquiry.\\nThe Mumbai Police already has its hands full with coronavirus pandemic issues and maintaining law and order under the circumstances.\\nHence, this laborious duty of conducting this inquiry with public credibility is being strained.\\nDepression could be common in the world of cinema, but why was he depressed?\",\n",
              "  'Text': \"At a time when fans and many personalities from the film fraternity have been demanding CBI inquiry in Sushant Singh Rajput's death case, now BJP MP Subramanian Swamy has written to PM Narendra Modi requesting a CBI probe into the case. In his letter, Swamy wrote, “I urge you... that you may consider advising the chief minister of Maharashtra directly or through the Governor to agree to a CBI inquiry. The Mumbai Police already has its hands full with coronavirus pandemic issues and maintaining law and order under the circumstances. Hence, this laborious duty of conducting this inquiry with public credibility is being strained. A CBI inquiry would be the only way to retain public confidence.” Recently, Swamy in a live conversation with advocate Ishkaran Singh Bhandari, who he appointed to process all the facts, said that he raised this subject because a young guy with a promising career and growing popularity suddenly dies by suicide. Depression could be common in the world of cinema, but why was he depressed?\",\n",
              "  'Title': 'Sushant Singh Rajput’s death: Subramanian Swamy writes to PM Narendra Modi requesting for CBI probe'},\n",
              " {'Keywords': ['raped',\n",
              "   'minor',\n",
              "   'isolation',\n",
              "   'pmch',\n",
              "   'station',\n",
              "   'private',\n",
              "   'child',\n",
              "   'security',\n",
              "   'shocking',\n",
              "   'guard',\n",
              "   'held',\n",
              "   'patna',\n",
              "   'hospital',\n",
              "   'railway',\n",
              "   'medical',\n",
              "   'ward',\n",
              "   'helpline'],\n",
              "  'Summary': 'Jul 16, 2020, 09:36AM ISTSource: Times NowA minor girl rescued from Barh railway station was allegedly raped inside the Covid-19 isolation ward of the Patna Medical College and Hospital (PMCH) by a private security guard.\\nThe incident took place on July 8 evening, the day she was brought to the PMCH isolation ward, but the police were informed only on Wednesday after the survivor narrated her ordeal to a child helpline staffer who had gone to visit her.\\nShe was found alone at Barh railway station and handed over to child helpline authorities.\\nPirbahore SHO Rizwan Ahmed Khan said, \"The accused Mahesh Kumar (40), a resident of Danapur, was arrested from PMCH.\\nHe is a retired Army man who was working with a private security guard agency and posted at the PMCH.\"',\n",
              "  'Text': 'Jul 16, 2020, 09:36AM IST\\n\\nSource: Times Now\\n\\nA minor girl rescued from Barh railway station was allegedly raped inside the Covid-19 isolation ward of the Patna Medical College and Hospital (PMCH) by a private security guard. The incident took place on July 8 evening, the day she was brought to the PMCH isolation ward, but the police were informed only on Wednesday after the survivor narrated her ordeal to a child helpline staffer who had gone to visit her. She was found alone at Barh railway station and handed over to child helpline authorities. Pirbahore SHO Rizwan Ahmed Khan said, \"The accused Mahesh Kumar (40), a resident of Danapur, was arrested from PMCH. He is a retired Army man who was working with a private security guard agency and posted at the PMCH.\"',\n",
              "  'Title': 'Shocking: Minor raped in Covid-19 isolation ward of Patna Medical College and Hospital, guard held'},\n",
              " {'Keywords': ['cat',\n",
              "   'catsource',\n",
              "   'shows',\n",
              "   'doubt',\n",
              "   'day',\n",
              "   'viral',\n",
              "   'toiinhere',\n",
              "   'kisses',\n",
              "   'reindeer',\n",
              "   'video'],\n",
              "  'Summary': 'Viral video: When reindeer kisses a catSource: TOI.inHere is an amazing video which shows how a reindeer kisses a cat.\\nThe video no doubt will make your day.',\n",
              "  'Text': 'Viral video: When reindeer kisses a cat\\n\\nSource: TOI.in\\n\\nHere is an amazing video which shows how a reindeer kisses a cat. The video no doubt will make your day.',\n",
              "  'Title': 'Viral video: When reindeer kisses a cat'}]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 34
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "US20tN4yUoGm",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 289
        },
        "outputId": "a0a730f4-b5b1-41b0-e39e-6bfbbeb0056f"
      },
      "source": [
        "# convert the dictionary data to a pandas dataframe\n",
        "\n",
        "dataset=pd.DataFrame(df)\n",
        "dataset.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Title</th>\n",
              "      <th>Text</th>\n",
              "      <th>Summary</th>\n",
              "      <th>Keywords</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Bill Barr: In first, US charges MS-13 leader w...</td>\n",
              "      <td>Attorney General Bill Barr announced the charg...</td>\n",
              "      <td>Attorney General Bill Barr announced the charg...</td>\n",
              "      <td>[announced, terror, bill, ms13, diaz, justice,...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Chilean police train dogs to sniff out Covid-19</td>\n",
              "      <td>Jul 15, 2020, 09:28PM IST\\n\\nSource: TOI.in\\n\\...</td>\n",
              "      <td>Jul 15, 2020, 09:28PM ISTSource: TOI.inPolice ...</td>\n",
              "      <td>[training, covid19, sniffing, trained, sniff, ...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Desperation science slows hunt for virus drugs</td>\n",
              "      <td>Jul 08, 2020, 10:27PM IST\\n\\nSource: AP\\n\\nDes...</td>\n",
              "      <td>Jul 08, 2020, 10:27PM ISTSource: APDesperate t...</td>\n",
              "      <td>[understanding, hunt, tens, desperation, virus...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>COVID-ravaged New York church reopens</td>\n",
              "      <td>Jul 08, 2020, 10:19PM IST\\n\\nSource: AP\\n\\nAft...</td>\n",
              "      <td>Jul 08, 2020, 10:19PM ISTSource: APAfter losin...</td>\n",
              "      <td>[saint, roman, lost, months, reopens, parishio...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>America disrupted: US on edge as presidential ...</td>\n",
              "      <td>Jul 07, 2020, 09:54PM IST\\n\\nSource: AP\\n\\nAme...</td>\n",
              "      <td>Jul 07, 2020, 09:54PM ISTSource: APAmerica Dis...</td>\n",
              "      <td>[edge, places, voting, likely, presidential, a...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                                               Title  ...                                           Keywords\n",
              "0  Bill Barr: In first, US charges MS-13 leader w...  ...  [announced, terror, bill, ms13, diaz, justice,...\n",
              "1    Chilean police train dogs to sniff out Covid-19  ...  [training, covid19, sniffing, trained, sniff, ...\n",
              "2     Desperation science slows hunt for virus drugs  ...  [understanding, hunt, tens, desperation, virus...\n",
              "3              COVID-ravaged New York church reopens  ...  [saint, roman, lost, months, reopens, parishio...\n",
              "4  America disrupted: US on edge as presidential ...  ...  [edge, places, voting, likely, presidential, a...\n",
              "\n",
              "[5 rows x 4 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 35
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "JS8GGkXfUtzf",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from xgboost.sklearn import XGBRegressor\n",
        "from sklearn.model_selection import train_test_split"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TvXtCEuwU1M7",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "# To train the model we used the UCI news data which is available at the following link.\n",
        "FILEPATH=\"https://raw.githubusercontent.com/heroorkrishna/News-Virality-Prediction/master/OnlineNewsPopularity.csv\""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "49ngkGoOgmkF",
        "colab_type": "text"
      },
      "source": [
        "Transform the data to train the model"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "6NUaIDUTZYAl",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def clean_cols(data):\n",
        "    \"\"\"Clean the column names by stripping and lowercase.\"\"\"\n",
        "    clean_col_map = {x: x.lower().strip() for x in list(data)}\n",
        "    return data.rename(index=str, columns=clean_col_map)\n",
        "\n",
        "def TrainTestSplit(X, Y, R=0, test_size=0.2):\n",
        "    \"\"\"Easy Train Test Split call.\"\"\"\n",
        "    return train_test_split(X, Y, test_size=test_size, random_state=R)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KWqFQRdhZdw2",
        "colab_type": "text"
      },
      "source": [
        "* I removed these features below because some of them are not available in our UCI training data. which we are using for training the model.\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "hBezV7L0ZiYV",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "full_data = clean_cols(pd.read_csv(FILEPATH))\n",
        "train_set, test_set = train_test_split(full_data, test_size=0.20, random_state=42)\n",
        "\n",
        "x_train = train_set.drop(['url','shares', 'timedelta', 'lda_00','lda_01','lda_02','lda_03','lda_04','num_self_hrefs', 'kw_min_min', 'kw_max_min', 'kw_avg_min','kw_min_max','kw_max_max','kw_avg_max','kw_min_avg','kw_max_avg','kw_avg_avg','self_reference_min_shares','self_reference_max_shares','self_reference_avg_sharess','rate_positive_words','rate_negative_words','abs_title_subjectivity','abs_title_sentiment_polarity'], axis=1)\n",
        "y_train = train_set['shares']\n",
        "\n",
        "x_test = test_set.drop(['url','shares', 'timedelta', 'num_self_hrefs', 'kw_min_min', 'kw_max_min', 'kw_avg_min','kw_min_max','kw_max_max','kw_avg_max','kw_min_avg','kw_max_avg','kw_avg_avg','self_reference_min_shares','self_reference_max_shares','self_reference_avg_sharess','rate_positive_words','rate_negative_words','abs_title_subjectivity','abs_title_sentiment_polarity'], axis=1)\n",
        "y_test = test_set['shares']"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "FDuw9sb8d99V",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 173
        },
        "outputId": "20fd4657-b67b-4ec7-fa6c-4ff5d4338526"
      },
      "source": [
        "clf=XGBRegressor(random_state=32,max_depth=5,n_estimators=1000)\n",
        "clf.fit(x_train, y_train)"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "[07:12:40] WARNING: /workspace/src/objective/regression_obj.cu:152: reg:linear is now deprecated in favor of reg:squarederror.\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "XGBRegressor(base_score=0.5, booster='gbtree', colsample_bylevel=1,\n",
              "             colsample_bynode=1, colsample_bytree=1, gamma=0,\n",
              "             importance_type='gain', learning_rate=0.1, max_delta_step=0,\n",
              "             max_depth=5, min_child_weight=1, missing=None, n_estimators=1000,\n",
              "             n_jobs=1, nthread=None, objective='reg:linear', random_state=32,\n",
              "             reg_alpha=0, reg_lambda=1, scale_pos_weight=1, seed=None,\n",
              "             silent=None, subsample=1, verbosity=1)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 46
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TOM9Sv4deBzT",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "rf_res = pd.DataFrame(clf.predict(x_train),list(y_train))"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "I7cQibWbeEHu",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 204
        },
        "outputId": "c250f308-5e36-487c-c007-4bc6d37bb481"
      },
      "source": [
        "rf_res.reset_index(level=0, inplace=True)\n",
        "rf_res_df = rf_res.rename(index=str, columns={\"index\": \"Actual shares\", 0: \"Predicted shares\"})\n",
        "rf_res_df.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Actual shares</th>\n",
              "      <th>Predicted shares</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>16100</td>\n",
              "      <td>4824.281250</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>508</td>\n",
              "      <td>813.780640</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>1300</td>\n",
              "      <td>3281.530762</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>3100</td>\n",
              "      <td>4311.856445</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>6900</td>\n",
              "      <td>5627.784668</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "   Actual shares  Predicted shares\n",
              "0          16100       4824.281250\n",
              "1            508        813.780640\n",
              "2           1300       3281.530762\n",
              "3           3100       4311.856445\n",
              "4           6900       5627.784668"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 48
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "PXwCVsDdeImZ",
        "colab_type": "text"
      },
      "source": [
        "**Converting Crawled News according to Training Set in UCI Dataset**"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "W8b0Fy1XeIDU",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 51
        },
        "outputId": "dfcbe733-6c0c-4f66-8d8e-4ae3949b7204"
      },
      "source": [
        "nltk.download('stopwords')\n",
        "from nltk.tokenize import word_tokenize \n",
        "from nltk.corpus import stopwords\n",
        "stopwords=set(stopwords.words('english'))"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "[nltk_data] Downloading package stopwords to /root/nltk_data...\n",
            "[nltk_data]   Unzipping corpora/stopwords.zip.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "9c7hwx9NeVaG",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def rate_unique(words):\n",
        "    words=tokenize(words)\n",
        "    no_order = list(set(words))\n",
        "    rate_unique=len(no_order)/len(words)\n",
        "    return rate_unique\n",
        "    \n",
        "def rate_nonstop(words):\n",
        "    words=tokenize(words)\n",
        "    filtered_sentence = [w for w in words if not w in stopwords]\n",
        "    rate_nonstop=len(filtered_sentence)/len(words)\n",
        "    no_order = list(set(filtered_sentence))\n",
        "    rate_unique_nonstop=len(no_order)/len(words)\n",
        "    return rate_nonstop,rate_unique_nonstop\n",
        "\n",
        "def avg_token(words):\n",
        "    words=tokenize(words)\n",
        "    length=[]\n",
        "    for i in words:\n",
        "        length.append(len(i))\n",
        "    return np.average(length)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "glVbQWPJeYI3",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from textblob import TextBlob"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "6Nz7fvDHeabE",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 173
        },
        "outputId": "f4fef3f6-a3ac-46a4-9ba2-1935681fd792"
      },
      "source": [
        "# intall the datefinder.\n",
        "!pip install datefinder"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Collecting datefinder\n",
            "  Downloading https://files.pythonhosted.org/packages/0c/4f/29524c9ca35d2ba1a8a3c6c895b90fc92525cf0fe357f747133890953ebe/datefinder-0.7.1-py2.py3-none-any.whl\n",
            "Requirement already satisfied: regex>=2017.02.08 in /usr/local/lib/python3.6/dist-packages (from datefinder) (2019.12.20)\n",
            "Requirement already satisfied: pytz in /usr/local/lib/python3.6/dist-packages (from datefinder) (2018.9)\n",
            "Requirement already satisfied: python-dateutil>=2.4.2 in /usr/local/lib/python3.6/dist-packages (from datefinder) (2.8.1)\n",
            "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.6/dist-packages (from python-dateutil>=2.4.2->datefinder) (1.12.0)\n",
            "Installing collected packages: datefinder\n",
            "Successfully installed datefinder-0.7.1\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ID2A7zW7eeaQ",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "import datefinder\n",
        "import datetime  \n",
        "from datetime import date \n",
        "def day(article_text):\n",
        "    article=article_text\n",
        "    if len(list(datefinder.find_dates(article)))>0:\n",
        "        date=str(list(datefinder.find_dates(article))[0])\n",
        "        date=date.split()\n",
        "        date=date[0]\n",
        "        year, month, day = date.split('-')     \n",
        "        day_name = datetime.date(int(year), int(month), int(day)) \n",
        "        return day_name.strftime(\"%A\")\n",
        "    return \"Sunday\""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "uT1MyqHZek9Y",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def tokenize(text):\n",
        "    text=text\n",
        "    return word_tokenize(text)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "M6FbbloQenTf",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "pos_words=[]\n",
        "neg_words=[]\n",
        "def polar(words):\n",
        "    all_tokens=tokenize(words)\n",
        "    for i in all_tokens:\n",
        "        analysis=TextBlob(i)\n",
        "        polarity=analysis.sentiment.polarity\n",
        "        if polarity>0:\n",
        "            pos_words.append(i)\n",
        "        if polarity<0:\n",
        "            neg_words.append(i)\n",
        "    return pos_words,neg_words"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "PWu_wLk0erU3",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def rates(words):\n",
        "    words=polar(words)\n",
        "    pos=words[0]\n",
        "    neg=words[1]\n",
        "    all_words=words\n",
        "    global_rate_positive_words=(len(pos)/len(all_words))/100\n",
        "    global_rate_negative_words=(len(neg)/len(all_words))/100\n",
        "    pol_pos=[]\n",
        "    pol_neg=[]\n",
        "    for i in pos:\n",
        "        analysis=TextBlob(i)\n",
        "        pol_pos.append(analysis.sentiment.polarity)\n",
        "        avg_positive_polarity=analysis.sentiment.polarity\n",
        "    for j in neg:\n",
        "        analysis2=TextBlob(j)\n",
        "        pol_neg.append(analysis2.sentiment.polarity)\n",
        "        avg_negative_polarity=analysis2.sentiment.polarity\n",
        "    min_positive_polarity=min(pol_pos)\n",
        "    max_positive_polarity=max(pol_pos)\n",
        "    min_negative_polarity=min(pol_neg)\n",
        "    max_negative_polarity=max(pol_neg)\n",
        "    avg_positive_polarity=np.average(pol_pos)\n",
        "    avg_negative_polarity=np.average(pol_neg)\n",
        "    return global_rate_positive_words,global_rate_negative_words,avg_positive_polarity,min_positive_polarity,max_positive_polarity,avg_negative_polarity,min_negative_polarity,max_negative_polarity"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "yXL0qU7Iez56",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "df2=[]\n",
        "for i in news:\n",
        "    pred_info={}\n",
        "    article = Article(i, language=\"en\") # en for English \n",
        "    article.download() \n",
        "    article.parse()\n",
        "    analysis=TextBlob(article.text)\n",
        "    polarity=analysis.sentiment.polarity\n",
        "    title_analysis=TextBlob(article.title)\n",
        "    pred_info['text']=article.text\n",
        "    pred_info['n_tokens_title']=len(tokenize(article.title))\n",
        "    pred_info['n_tokens_content']=len(tokenize(article.text))\n",
        "    pred_info['n_unique_tokens']=rate_unique(article.text)\n",
        "    pred_info['n_non_stop_words']=rate_nonstop(article.text)[0]\n",
        "    pred_info['n_non_stop_unique_tokens']=rate_nonstop(article.text)[1]\n",
        "    pred_info['num_hrefs']=article.html.count(\"https://timesofindia.indiatimes.com\")\n",
        "    pred_info['num_imgs']=len(article.images)\n",
        "    pred_info['num_videos']=len(article.movies)\n",
        "    pred_info['average_token_length']=avg_token(article.text)\n",
        "    pred_info['num_keywords']=len(article.keywords)\n",
        "    \n",
        "    if \"life-style\" in article.url:\n",
        "        pred_info['data_channel_is_lifestyle']=1\n",
        "    else:\n",
        "        pred_info['data_channel_is_lifestyle']=0\n",
        "    if \"etimes\" in article.url:\n",
        "        pred_info['data_channel_is_entertainment']=1\n",
        "    else:\n",
        "        pred_info['data_channel_is_entertainment']=0\n",
        "    if \"business\" in article.url:\n",
        "        pred_info['data_channel_is_bus']=1\n",
        "    else:\n",
        "        pred_info['data_channel_is_bus']=0\n",
        "    if \"social media\" or \"facebook\" or \"whatsapp\" in article.text.lower():\n",
        "        data_channel_is_socmed=1\n",
        "        data_channel_is_tech=0\n",
        "        data_channel_is_world=0\n",
        "    else:\n",
        "        data_channel_is_socmed=0\n",
        "    if (\"technology\" or \"tech\" in article.text.lower()) or (\"technology\" or \"tech\" in article.url):\n",
        "        data_channel_is_tech=1\n",
        "        data_channel_is_socmed=0\n",
        "        data_channel_is_world=0\n",
        "    else:\n",
        "        data_channel_is_tech=0\n",
        "    if \"world\" in article.url:\n",
        "        data_channel_is_world=1\n",
        "        data_channel_is_tech=0\n",
        "        data_channel_is_socmed=0\n",
        "    else:\n",
        "        data_channel_is_world=0\n",
        "        \n",
        "    pred_info['data_channel_is_socmed']=data_channel_is_socmed\n",
        "    pred_info['data_channel_is_tech']=data_channel_is_tech\n",
        "    pred_info['data_channel_is_world']=data_channel_is_world\n",
        "    \n",
        "    if day(i)==\"Monday\":\n",
        "        pred_info['weekday_is_monday']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_monday']=0\n",
        "    if day(i)==\"Tuesday\":\n",
        "        pred_info['weekday_is_tuesday']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_tuesday']=0\n",
        "    if day(i)==\"Wednesday\":\n",
        "        pred_info['weekday_is_wednesday']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_wednesday']=0\n",
        "    if day(i)==\"Thursday\":\n",
        "        pred_info['weekday_is_thursday']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_thursday']=0\n",
        "    if day(i)==\"Friday\":\n",
        "        pred_info['weekday_is_friday']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_friday']=0\n",
        "    if day(i)==\"Saturday\":\n",
        "        pred_info['weekday_is_saturday']=1\n",
        "        pred_info['is_weekend']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_saturday']=0\n",
        "    if day(i)==\"Sunday\":\n",
        "        pred_info['weekday_is_sunday']=1\n",
        "        pred_info['is_weekend']=1\n",
        "    else:\n",
        "        pred_info['weekday_is_sunday']=0\n",
        "        pred_info['is_weekend']=0\n",
        "        \n",
        "    pred_info['global_subjectivity']=analysis.sentiment.subjectivity\n",
        "    pred_info['global_sentiment_polarity']=analysis.sentiment.polarity\n",
        "    pred_info['global_rate_positive_words']=rates(article.text)[0]\n",
        "    pred_info['global_rate_negative_words']=rates(article.text)[1]\n",
        "    pred_info['avg_positive_polarity']=rates(article.text)[2]\n",
        "    pred_info['min_positive_polarity']=rates(article.text)[3]\n",
        "    pred_info['max_positive_polarity']=rates(article.text)[4]\n",
        "    pred_info['avg_negative_polarity']=rates(article.text)[5]\n",
        "    pred_info['min_negative_polarity']=rates(article.text)[6]\n",
        "    pred_info['max_negative_polarity']=rates(article.text)[7]    \n",
        "    pred_info['title_subjectivity']=title_analysis.sentiment.subjectivity\n",
        "    pred_info['title_sentiment_polarity']=title_analysis.sentiment.polarity\n",
        "    df2.append(pred_info)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "UucDwvr5e4ID",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 496
        },
        "outputId": "3a4c3a9a-ac6f-4385-ec7b-1843c0d0e3a2"
      },
      "source": [
        "pred_df=pd.DataFrame(df2)\n",
        "pred_test=pred_df.drop(['text'],axis=1)\n",
        "pred_df.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>text</th>\n",
              "      <th>n_tokens_title</th>\n",
              "      <th>n_tokens_content</th>\n",
              "      <th>n_unique_tokens</th>\n",
              "      <th>n_non_stop_words</th>\n",
              "      <th>n_non_stop_unique_tokens</th>\n",
              "      <th>num_hrefs</th>\n",
              "      <th>num_imgs</th>\n",
              "      <th>num_videos</th>\n",
              "      <th>average_token_length</th>\n",
              "      <th>num_keywords</th>\n",
              "      <th>data_channel_is_lifestyle</th>\n",
              "      <th>data_channel_is_entertainment</th>\n",
              "      <th>data_channel_is_bus</th>\n",
              "      <th>data_channel_is_socmed</th>\n",
              "      <th>data_channel_is_tech</th>\n",
              "      <th>data_channel_is_world</th>\n",
              "      <th>weekday_is_monday</th>\n",
              "      <th>weekday_is_tuesday</th>\n",
              "      <th>weekday_is_wednesday</th>\n",
              "      <th>weekday_is_thursday</th>\n",
              "      <th>weekday_is_friday</th>\n",
              "      <th>weekday_is_saturday</th>\n",
              "      <th>weekday_is_sunday</th>\n",
              "      <th>is_weekend</th>\n",
              "      <th>global_subjectivity</th>\n",
              "      <th>global_sentiment_polarity</th>\n",
              "      <th>global_rate_positive_words</th>\n",
              "      <th>global_rate_negative_words</th>\n",
              "      <th>avg_positive_polarity</th>\n",
              "      <th>min_positive_polarity</th>\n",
              "      <th>max_positive_polarity</th>\n",
              "      <th>avg_negative_polarity</th>\n",
              "      <th>min_negative_polarity</th>\n",
              "      <th>max_negative_polarity</th>\n",
              "      <th>title_subjectivity</th>\n",
              "      <th>title_sentiment_polarity</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Attorney General Bill Barr announced the charg...</td>\n",
              "      <td>12</td>\n",
              "      <td>407</td>\n",
              "      <td>0.511057</td>\n",
              "      <td>0.700246</td>\n",
              "      <td>0.425061</td>\n",
              "      <td>229</td>\n",
              "      <td>13</td>\n",
              "      <td>0</td>\n",
              "      <td>4.906634</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.461776</td>\n",
              "      <td>-0.037361</td>\n",
              "      <td>0.055</td>\n",
              "      <td>0.09</td>\n",
              "      <td>0.236049</td>\n",
              "      <td>0.05</td>\n",
              "      <td>0.5</td>\n",
              "      <td>-0.392284</td>\n",
              "      <td>-0.8</td>\n",
              "      <td>-0.05</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>0.250000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Jul 15, 2020, 09:28PM IST\\n\\nSource: TOI.in\\n\\...</td>\n",
              "      <td>8</td>\n",
              "      <td>112</td>\n",
              "      <td>0.732143</td>\n",
              "      <td>0.678571</td>\n",
              "      <td>0.544643</td>\n",
              "      <td>185</td>\n",
              "      <td>9</td>\n",
              "      <td>0</td>\n",
              "      <td>4.160714</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>0.500000</td>\n",
              "      <td>0.400000</td>\n",
              "      <td>0.450</td>\n",
              "      <td>0.36</td>\n",
              "      <td>0.246514</td>\n",
              "      <td>0.05</td>\n",
              "      <td>0.5</td>\n",
              "      <td>-0.392284</td>\n",
              "      <td>-0.8</td>\n",
              "      <td>-0.05</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Jul 08, 2020, 10:27PM IST\\n\\nSource: AP\\n\\nDes...</td>\n",
              "      <td>7</td>\n",
              "      <td>117</td>\n",
              "      <td>0.726496</td>\n",
              "      <td>0.649573</td>\n",
              "      <td>0.547009</td>\n",
              "      <td>185</td>\n",
              "      <td>9</td>\n",
              "      <td>0</td>\n",
              "      <td>4.487179</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.681250</td>\n",
              "      <td>0.056250</td>\n",
              "      <td>0.545</td>\n",
              "      <td>0.39</td>\n",
              "      <td>0.278759</td>\n",
              "      <td>0.05</td>\n",
              "      <td>0.6</td>\n",
              "      <td>-0.417160</td>\n",
              "      <td>-0.8</td>\n",
              "      <td>-0.05</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>Jul 08, 2020, 10:19PM IST\\n\\nSource: AP\\n\\nAft...</td>\n",
              "      <td>5</td>\n",
              "      <td>54</td>\n",
              "      <td>0.870370</td>\n",
              "      <td>0.796296</td>\n",
              "      <td>0.703704</td>\n",
              "      <td>185</td>\n",
              "      <td>9</td>\n",
              "      <td>0</td>\n",
              "      <td>4.518519</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>0.337576</td>\n",
              "      <td>0.037273</td>\n",
              "      <td>0.735</td>\n",
              "      <td>0.49</td>\n",
              "      <td>0.291708</td>\n",
              "      <td>0.05</td>\n",
              "      <td>0.6</td>\n",
              "      <td>-0.416122</td>\n",
              "      <td>-0.8</td>\n",
              "      <td>-0.05</td>\n",
              "      <td>0.454545</td>\n",
              "      <td>0.136364</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Jul 07, 2020, 09:54PM IST\\n\\nSource: AP\\n\\nAme...</td>\n",
              "      <td>10</td>\n",
              "      <td>51</td>\n",
              "      <td>0.823529</td>\n",
              "      <td>0.745098</td>\n",
              "      <td>0.627451</td>\n",
              "      <td>185</td>\n",
              "      <td>9</td>\n",
              "      <td>0</td>\n",
              "      <td>4.078431</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>0.508333</td>\n",
              "      <td>-0.066667</td>\n",
              "      <td>0.840</td>\n",
              "      <td>0.53</td>\n",
              "      <td>0.280138</td>\n",
              "      <td>0.05</td>\n",
              "      <td>0.6</td>\n",
              "      <td>-0.402222</td>\n",
              "      <td>-0.8</td>\n",
              "      <td>-0.05</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                                                text  ...  title_sentiment_polarity\n",
              "0  Attorney General Bill Barr announced the charg...  ...                  0.250000\n",
              "1  Jul 15, 2020, 09:28PM IST\\n\\nSource: TOI.in\\n\\...  ...                  0.000000\n",
              "2  Jul 08, 2020, 10:27PM IST\\n\\nSource: AP\\n\\nDes...  ...                  0.000000\n",
              "3  Jul 08, 2020, 10:19PM IST\\n\\nSource: AP\\n\\nAft...  ...                  0.136364\n",
              "4  Jul 07, 2020, 09:54PM IST\\n\\nSource: AP\\n\\nAme...  ...                  0.000000\n",
              "\n",
              "[5 rows x 37 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 58
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4aMzvih4e8_M",
        "colab_type": "text"
      },
      "source": [
        "Final Results depicting the Likelihood of Virality of News"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "cJ23E9uTesl3",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "cd6aa788-b503-4c8d-c342-8277a2a0e025"
      },
      "source": [
        "test2=pd.DataFrame(clf.predict(pred_test),pred_df['text'])\n",
        "test2.reset_index(level=0, inplace=True)\n",
        "test2 = test2.rename(index=str, columns={\"index\": \"News\", 0: \"Virality\"})\n",
        "test2"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>text</th>\n",
              "      <th>Virality</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Attorney General Bill Barr announced the charg...</td>\n",
              "      <td>9392.894531</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Jul 15, 2020, 09:28PM IST\\n\\nSource: TOI.in\\n\\...</td>\n",
              "      <td>35716.289062</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Jul 08, 2020, 10:27PM IST\\n\\nSource: AP\\n\\nDes...</td>\n",
              "      <td>40506.992188</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>Jul 08, 2020, 10:19PM IST\\n\\nSource: AP\\n\\nAft...</td>\n",
              "      <td>51604.656250</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>Jul 07, 2020, 09:54PM IST\\n\\nSource: AP\\n\\nAme...</td>\n",
              "      <td>32206.533203</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <td>Jul 07, 2020, 09:53PM IST\\n\\nSource: AP\\n\\nTom...</td>\n",
              "      <td>23513.542969</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6</th>\n",
              "      <td>Jul 07, 2020, 09:51PM IST\\n\\nSource: AP\\n\\nUS ...</td>\n",
              "      <td>24541.496094</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7</th>\n",
              "      <td>Jul 03, 2020, 08:59PM IST\\n\\nSource: AP\\n\\nAhe...</td>\n",
              "      <td>72445.953125</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>8</th>\n",
              "      <td>Jul 03, 2020, 08:54PM IST\\n\\nSource: AP\\n\\nRen...</td>\n",
              "      <td>60149.453125</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9</th>\n",
              "      <td>Jun 29, 2020, 03:44PM IST\\n\\nSource: TOI.in\\n\\...</td>\n",
              "      <td>28198.240234</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>10</th>\n",
              "      <td>Jun 25, 2020, 08:06PM IST\\n\\nSource: AP\\n\\nWhi...</td>\n",
              "      <td>15531.276367</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>11</th>\n",
              "      <td>WASHINGTON: TikTok , the wildly popular social...</td>\n",
              "      <td>30923.484375</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12</th>\n",
              "      <td>RAWALPINDI: Oman may become the first country ...</td>\n",
              "      <td>25848.708984</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13</th>\n",
              "      <td>Referring to him only as \"Patient 206,'' gover...</td>\n",
              "      <td>33903.621094</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>14</th>\n",
              "      <td>LONDON: Positive news on initial trials of the...</td>\n",
              "      <td>21118.634766</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>15</th>\n",
              "      <td>MOSCOW: Dozens of people were arrested at a pr...</td>\n",
              "      <td>23780.421875</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>16</th>\n",
              "      <td>BEIJING: In the global race to make a coronavi...</td>\n",
              "      <td>30501.517578</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>17</th>\n",
              "      <td>ANKARA: A small plane belonging to Turkey 's p...</td>\n",
              "      <td>37898.976562</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>18</th>\n",
              "      <td>Two US-made AH-64E Apache attack helicopters r...</td>\n",
              "      <td>33785.203125</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>19</th>\n",
              "      <td>LA PAZ: Bolivian sex workers in the capital La...</td>\n",
              "      <td>16025.996094</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>20</th>\n",
              "      <td>WASHINGTON: An Indian-American couple has been...</td>\n",
              "      <td>17743.035156</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>21</th>\n",
              "      <td>SRINAGAR: Doctors from Kashmir working in Brit...</td>\n",
              "      <td>19969.769531</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>22</th>\n",
              "      <td>Dr. Ankit Bharat, chief of thoracic surgery at...</td>\n",
              "      <td>23610.917969</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>23</th>\n",
              "      <td>Sampat Shivangi (File photo)\\n\\nWASHINGTON: An...</td>\n",
              "      <td>21106.269531</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>24</th>\n",
              "      <td>Representative image\\n\\nSINGAPORE: An Indian-o...</td>\n",
              "      <td>30524.705078</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25</th>\n",
              "      <td>Jayanth Challa\\n\\nHYDERABAD: The Virginia gove...</td>\n",
              "      <td>23545.878906</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>26</th>\n",
              "      <td>NEW YORK: Two renowned Indian-Americans who ha...</td>\n",
              "      <td>23702.742188</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>27</th>\n",
              "      <td>Donald Trump\\n\\nWASHINGTON: US President Donal...</td>\n",
              "      <td>14441.878906</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>28</th>\n",
              "      <td>Jul 16, 2020, 11:40AM IST\\n\\nSource: Times Now...</td>\n",
              "      <td>35679.937500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>29</th>\n",
              "      <td>Bikini season is officially here! But the nove...</td>\n",
              "      <td>45232.582031</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>30</th>\n",
              "      <td>At a time when fans and many personalities fro...</td>\n",
              "      <td>32469.382812</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>31</th>\n",
              "      <td>Jul 16, 2020, 09:36AM IST\\n\\nSource: Times Now...</td>\n",
              "      <td>56174.488281</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>32</th>\n",
              "      <td>Viral video: When reindeer kisses a cat\\n\\nSou...</td>\n",
              "      <td>61289.855469</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                                                 text      Virality\n",
              "0   Attorney General Bill Barr announced the charg...   9392.894531\n",
              "1   Jul 15, 2020, 09:28PM IST\\n\\nSource: TOI.in\\n\\...  35716.289062\n",
              "2   Jul 08, 2020, 10:27PM IST\\n\\nSource: AP\\n\\nDes...  40506.992188\n",
              "3   Jul 08, 2020, 10:19PM IST\\n\\nSource: AP\\n\\nAft...  51604.656250\n",
              "4   Jul 07, 2020, 09:54PM IST\\n\\nSource: AP\\n\\nAme...  32206.533203\n",
              "5   Jul 07, 2020, 09:53PM IST\\n\\nSource: AP\\n\\nTom...  23513.542969\n",
              "6   Jul 07, 2020, 09:51PM IST\\n\\nSource: AP\\n\\nUS ...  24541.496094\n",
              "7   Jul 03, 2020, 08:59PM IST\\n\\nSource: AP\\n\\nAhe...  72445.953125\n",
              "8   Jul 03, 2020, 08:54PM IST\\n\\nSource: AP\\n\\nRen...  60149.453125\n",
              "9   Jun 29, 2020, 03:44PM IST\\n\\nSource: TOI.in\\n\\...  28198.240234\n",
              "10  Jun 25, 2020, 08:06PM IST\\n\\nSource: AP\\n\\nWhi...  15531.276367\n",
              "11  WASHINGTON: TikTok , the wildly popular social...  30923.484375\n",
              "12  RAWALPINDI: Oman may become the first country ...  25848.708984\n",
              "13  Referring to him only as \"Patient 206,'' gover...  33903.621094\n",
              "14  LONDON: Positive news on initial trials of the...  21118.634766\n",
              "15  MOSCOW: Dozens of people were arrested at a pr...  23780.421875\n",
              "16  BEIJING: In the global race to make a coronavi...  30501.517578\n",
              "17  ANKARA: A small plane belonging to Turkey 's p...  37898.976562\n",
              "18  Two US-made AH-64E Apache attack helicopters r...  33785.203125\n",
              "19  LA PAZ: Bolivian sex workers in the capital La...  16025.996094\n",
              "20  WASHINGTON: An Indian-American couple has been...  17743.035156\n",
              "21  SRINAGAR: Doctors from Kashmir working in Brit...  19969.769531\n",
              "22  Dr. Ankit Bharat, chief of thoracic surgery at...  23610.917969\n",
              "23  Sampat Shivangi (File photo)\\n\\nWASHINGTON: An...  21106.269531\n",
              "24  Representative image\\n\\nSINGAPORE: An Indian-o...  30524.705078\n",
              "25  Jayanth Challa\\n\\nHYDERABAD: The Virginia gove...  23545.878906\n",
              "26  NEW YORK: Two renowned Indian-Americans who ha...  23702.742188\n",
              "27  Donald Trump\\n\\nWASHINGTON: US President Donal...  14441.878906\n",
              "28  Jul 16, 2020, 11:40AM IST\\n\\nSource: Times Now...  35679.937500\n",
              "29  Bikini season is officially here! But the nove...  45232.582031\n",
              "30  At a time when fans and many personalities fro...  32469.382812\n",
              "31  Jul 16, 2020, 09:36AM IST\\n\\nSource: Times Now...  56174.488281\n",
              "32  Viral video: When reindeer kisses a cat\\n\\nSou...  61289.855469"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 59
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "NJ29OnPCgbfZ",
        "colab_type": "text"
      },
      "source": [
        "Here we got the virality of different news based on Xgb regressor model. This is not the best because our training data is of different news categories and also the timing of news."
      ]
    }
  ]
}