I was trying this search.py code base to scrape that website using url along with search_url. It produces results in json format - how was it achieved using the dev-tools?
I can see that a request was sent using first the referer_link
headers = {'Referer': referer_link, 'X-Requested-With': 'XMLHttpRequest'} followed by a pause and then the search url with the query key/values
html = client.request(url, headers=headers)I am trying to replicate that in the firefox dev-tools but can't seem to get what other query key/value parameters are available to try. How can I obtain them?
I ask with a specific question - I tried a modified version of that search query
https://rlsbb.cc/Home/GetPost?phrase=&pindex=1
and it returns the current posts on the webpage in json but I do not know how to restrict the query to giving just tv-shows within a specified period like:e.g. category - tv-shows between date - 2024-03-01 and date- 2024-03-02?
The website does not have any api documentation, at least to my knowledge.If this can be achieved then scraping html can be avoided as json data is easier to code in python.Thank you for your attention and time.OZooHA