Skip to content
This repository was archived by the owner on May 4, 2021. It is now read-only.
This repository was archived by the owner on May 4, 2021. It is now read-only.

Old style non-open-graph score tags are not handled #28

@pushrbx

Description

@pushrbx

There is no span tag around the score here: https://myanimelist.net/manga/63
However there is a span tag around the score here: https://myanimelist.net/anime/32281/Kimi_no_Na_wa

Traceback (most recent call last):
  File "C:\Users\pushrbx\.pyenvs\scraping-test\lib\site-packages\twisted\internet\defer.py", line 653, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "C:\Users\pushrbx\Documents\Projects\it-scraper\mal_crawler\spiders.py", line 181, in parse
    parse_result = manga.parse(page)
  File "C:\Users\pushrbx\.pyenvs\scraping-test\lib\site-packages\myanimelist\media.py", line 337, in parse
    media_info = self.parse_sidebar(media_page)
  File "C:\Users\pushrbx\.pyenvs\scraping-test\lib\site-packages\myanimelist\manga.py", line 71, in parse_sidebar
    manga_info = super(Manga, self).parse_sidebar(manga_page)
  File "C:\Users\pushrbx\.pyenvs\scraping-test\lib\site-packages\myanimelist\media.py", line 256, in parse_sidebar
    score = float(utilities.css_select('span.dark_text + span', score_tag_results[0])[0].text)
IndexError: list index out of range

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions