Jump to content

» «

Web scraping related question [JS]

No replies to this topic
  • Shmoopy

    Lost interest in GTA

  • Members
  • Joined: 16 Jun 2009
  • None


Posted 31 January 2017 - 09:18 PM Edited by Shmoopy, 01 February 2017 - 02:56 AM.

Hi there,

I would like to know how do web scraping I/O services manage to scrape websites without getting blocked by the CORS.

Because I've tried scraping with a tool I've made with Javascript, but my Iframe keeps getting blocked by the browser because of the Cross-origin request. ( Tested with all the main browsers )


However, when I've exported my project with NWJS, there was no CORS. But I don't want to build a desktop software, instead I wanna make a Web app like all the services out there.


So my question is, how do web scrapping services manage to bypass CORS ?




Found the secret:

<object data="http://www.web-source.net" width="600" height="400">
    <embed src="http://www.web-source.net" width="600" height="400"> </embed>
    Error: Embedded data could not be displayed.
  • trip likes this

1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users