Feed Seeker

https://pypi.org/project/feed-seeker/
Admin
Feed-seeker is a Python library for finding RSS, Atom, XML, and RDF feeds on webpages.
Tokens:1,540
Snippets:18
Trust Score:10
Update:4 months ago
Show doc for...
Tokens:
Raw
### Install feed-seeker

Source: https://pypi.org/project/feed-seeker

Install the library using pip. Requires Python 3.5+.

```bash
pip install feed_seeker
```

--------------------------------

### Generate potential feed URLs

Source: https://pypi.org/project/feed-seeker

Use `generate_feed_urls` to get a list of likely feed candidates, ordered from most to least prominent. This function returns a generator.

```python
from feed_seeker import generate_feed_urls

>>> for url in generate_feed_urls('https://xkcd.com'):
...     print(url)
...
https://xkcd.com/atom.xml
https://xkcd.com/rss.xml
```

--------------------------------

### Find the most likely feed URL

Source: https://pypi.org/project/feed-seeker

Use `find_feed_url` to quickly get the most probable feed URL from a webpage. It uses `requests` by default to fetch and inspect HTML.

```python
from feed_seeker import find_feed_url

>>> find_feed_url('https://github.com/mitmedialab/feed_seeker')
'https://github.com/mitmedialab/feed_seeker/commits/master.atom'
```

--------------------------------

### Thorough feed search with spidering

Source: https://pypi.org/project/feed-seeker

Use `generate_feed_urls` with the `spider` argument for a depth-first search of URLs on the same hostname. This can be time-consuming.

```python
>>> for url in generate_feed_urls('https://github.com/mitmedialab/feed_seeker', spider=1):
...     print(url)
...
https://github.com/mitmedialab/feed_seeker/commits/master.atom,
https://github.com/mitmedialab/feed_seeker/commits/95cf320796c487df8b70f9c42281d8f26452cc31.atom,
https://github.com/mitmedialab/feed_seeker/commits/3e93490cb91f7652325c2fe41ef29a5be4558d6a.atom,
https://github.com/mitmedialab/feed_seeker/commits/659311b8853c4c4a67e3b4bc67a78461d825a064.atom,
https://github.com/mitmedialab/feed_seeker/commits/a8f7b86eac2cedd9209ac5d2ddcceb293d2404c9.atom,
https://github.com/index.atom,
https://github.com/articles.atom,
https://github.com/dfm/feedfinder2/commits/master.atom,
https://github.com/blog.atom,
https://github.com/blog/all.atom,
https://github.com/blog/broadcasts.atom,
https://github.com/ColCarroll.atom
```

--------------------------------

### Set a timeout for feed searching

Source: https://pypi.org/project/feed-seeker/1.1.0

Configure a maximum execution time for feed searches using the `max_time` argument in `find_feed_url`. This prevents the function from running indefinitely on slow or unresponsive URLs.

```python
>>> for url in ('https://httpstat.us/200?sleep=5000', 'https://github.com/mitmedialab/feed_seeker'):
   ...     try:
   ...         print('found feed:\t{}'.format(find_feed_url(url, max_time=3)))
   ...     except TimeoutError:
   ...         print('skipping {}'.format(url))
   skipping https://httpstat.us/200?sleep=5000
   found feed:  https://github.com/mitmedialab/feed_seeker/commits/master.atom
```

--------------------------------

### Set a timeout for feed searching

Source: https://pypi.org/project/feed-seeker

When processing a list of URLs, use the `max_time` argument in `find_feed_url` to prevent excessively long searches. Handles `TimeoutError`.

```python
>>> for url in ('https://httpstat.us/200?sleep=5000', 'https://github.com/mitmedialab/feed_seeker'):
   ...     try:
   ...         print('found feed:\t{}'.format(find_feed_url(url, max_time=3)))
   ...     except TimeoutError:
   ...         print('skipping {}'.format(url))
   ...
   skipping https://httpstat.us/200?sleep=5000
   found feed:  https://github.com/mitmedialab/feed_seeker/commits/master.atom
```

--------------------------------

### Find Feedly feeds for a site

Source: https://pypi.org/project/feed-seeker

Use `find_feedly_feeds` to search Feedly for relevant feeds associated with a given website URL.

```python
from feed_seeker import find_feedly_feeds

>>> for url in find_feedly_feeds('https://www.nytimes.com'):
...     print(url)
...

http://www.nytimes.com/services/xml/rss/nyt/HomePage.xml
http://www.nytimes.com/services/xml/rss/nyt/HomePage.xml
http://www.nytimes.com/services/xml/rss/nyt/Science.xml
http://www.nytimes.com/services/xml/rss/nyt/Travel.xml
http://www.nytimes.com/services/xml/rss/nyt/Technology.xml
http://www.nytimes.com/services/xml/rss/nyt/Business.xml
```
Tokens:
Raw