Quantcast
Channel: Active questions tagged python - Stack Overflow
Viewing all articles
Browse latest Browse all 14011

how do I extract things with weird ids and class names using scrapy and scrapy-splash? [duplicate]

$
0
0

I am trying to extract data from this website:

https://catalog.registrar.ucla.edu/major/2022/mathematicsofcomputationbs?siteYear=2022

I'm starting off by trying to get the "Overview" text using both CSS and xpath but nothing seems to be working and the class names and id seem to be long and random, which I assume is because its JavaScript generated. I was wondering how I would approach extracting data with those type of class names using scrapy-splash and scrapy. It would be very helpful if you can link some video or articles too.


Viewing all articles
Browse latest Browse all 14011

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>