3. ABSTRACT
The internet is filled with information and news, and keeping on
top of all it is next to impossible. But it is very important for
everyone to make sure they are up to date. Visiting every single
one that you’re interested in can be immense and time consuming
task.
That’s where News Aggregators come in and make the task
easier. News aggregators can save user the time and resources
that would normally be needed to gather all this information. This
project fulfills it’s main goal of developing a news aggregator
using Django framework that is able to aggregate news articles
from different sources.
4. In a news aggregator, reader can select the websites they want to
follow. Then the news aggregator collects the articles and makes
the reader one click away to get information from various
websites.
It gives the users with a web link of news article, which provides
the reader with a trusted source of news and keeps them stay
afloat in an unending sea of news.
5. INTRODUCTION
The arrival of the web and the social web brings with it a
tremendous amount of news sources.
The accessibility of these news sources generates a large wave of
information which can often times be contradicting and
confusing.
6. For example many companies like face book can be seen as a
social platform that allows individuals and groups of individuals
to freely exchange thoughts and opinions on the latest news.
So as social media being common in these days making an
effecting news aggregator that make user time saving can be very
useful.
In a News Aggregator, you can select the Websites one can
follow. Then he news aggregator collects the articles for users and
then they will be a click away to get information from various
websites.
7. IMPLEMENTATION
Methodology and Design:
SCRAPING THE WEBSITE
Scraping the news from the website is done by using Beautiful
Soup and request module. In the request module the session object will be
the first variable first variable. These are essential to make a connection to
the server. This is the abstraction provided by requests framework.
8. STORING THE DATA
In this Model Headline is used to carry out the purpose. It
will perform the standard storing procedure. It contains a separate
variable for storing the content that is extracted by creating a new
Headline() object. This stored data further used in visualization.
9. SERVING THE DATA OBJECTS:
Serving the data that is stored is a simple process, and is
done by creating a view function. The function is defined by
extracting all the elements from the variables. The stored list is
reversed for getting the latest information on top and the list is passed
in as a context. This context is further displayed using HTML and
Django.
12. CONCLUSION
By the web crawling techniques and methodologies discussed
earlier we can come to a conclusion that news aggregator will be
an effective platform for users to get modified news summary
with minimal effort.
News Aggregator reduces the time needed to regularly check
websites for updates by creating a unique information space or
personal newspaper.
So from above all we conclude that aggregation technology helps
to consolidate many websites into one page that can show only
the information and also News Aggregator has a strong societal
importance which allows individuals to save their valuable time.
13. FUTURE ENHANCEMENTS
The future of News Aggregation is actually linked with the future
of web and social media. With 90 percent of the data piled up in
the last two years, web is a giant mechanism absorbing data.
Add to this the rise of mobile devices, lightning fast internet
speed and increasingly cheaper internet access and you have
struck the right combination of web and web data.
Since data is getting added at a lightening pace, web scraping is
the natural response. As today’s world of business strategy is
driven entirely by data, news aggregation is only going to grow
manifold.
