How To Use HEADERS in SCRAPY SHELL, Python Requests, and CURL - code examples

See how to add headers in the scrapy shell fetch command
and how to use cURL to check a URL via command line.

Make a get request with cURL to an API and got some JSON in the response

Links featured in the video :

https://reqbin.com/req/c-1n4ljxb9/curl-get-request
https://michael-shub.github.io/curl2scrapy/
https://docs.scrapy.org/en/latest/topics/developer-tools.html#requests-from-curl
https://docs.scrapy.org/en/latest/topics/developer-tools.html#inspecting-a-website

🔲 See also https://github.com/RGGH/Scrapy14/blob/main/README.md as the content here will follow on into my next Scrapy project, and you will see the step by step progress here.

Visit redandgreen blog for more Tutorials
=========================================
🌏 http://redandgreen.co.uk/about/blog/

Subscribe to the YouTube Channel
=================================
🌏 https://www.youtube.com/c/DrPiCode

Follow on Twitter - to get notified of new videos
=================================================
🌏 https://twitter.com/RngWeb

Buy Dr Pi a coffee (or Tea)
☕ https://www.buymeacoffee.com/DrPi

Thumbs up yeah? (cos Algos..)

#webscraping #tutorials #python #arduino