download webpage Complete

[User 9427106]

Hi How can i download all content of this page : http://tehran.divar.ir/browse/ I think this is full ajax Cause when u scroll down the page it reload the new data! Please Help?

[Lost User]

Depending on which browser you are using, you should be able to use the context or main menu to do a Save As operation.

[User 9427106]

thanks for reply! but the page is Compeletly ajax,so i should scroll down and down to reload the info! other website act same as this : http://demos.9lessons.info/load_data_scroll.php[^] i wanna do that in C#! thanks in advanced!

[Lost User]

Sorry, but I'm not sure what your problem is in terms of C#.

[Kornfeld Eliyahu Peter]

Why should you get all the content of someone else's site? It's not yours! You should not touch it!

I'm not questioning your powers of observation; I'm merely remarking upon the paradox of asking a masked man who he is. (V)

[User 9427106]

I am doing it for testing and get info of other website for some use!

[User 9427106]

In other words : What's the best way to scrape a web page that has AJAX/dynamic loading of data? For example: scraping a webpage that presents 20 images on load, but when a user scroll down the page it loads more images (sort of like Facebook). In such a case how do you scrape all the images, not just the first 20?

[Lost User]

Use Fiddler (or something likewise) to see if it makes a specific call to fetch the data. You're looking for anything that gets loaded by the page using JavaScript and that returns some XML/JSON. If that fails, then there's always the WebBrowser control :)

Bastard Programmer from Hell :suss: If you can't read my code, try converting it here[^]

[User 9427106]

I am using this code in ASP.net :

<script type="text/javascript">
function getDataS() {
var dd = '{"jsonrpc":"2.0","method":"getPostList","id":1,"params":[1,[["place2",0,[1,1]]],173099135176724],"hash":"decfe7c9183f16efa1291f5131902f7d4ef4ff14"}';
$.ajax({
type: "POST",
//type: "GET",
url: "http://tehran.divar.ir/browse/json/?tm=1407824648578",
// url: 'http://tehran.divar.ir/browse/',
//url: "http://tehran.divar.ir/",
contentType: "application/json; charset=utf-8",
// contentType:"application/x-www-form-urlencoded; charset=UTF-8",
dataType: "json",
async: true,
crossDomain: true,
data: '{"jsonrpc":"2.0","method":"getPostList","id":1,"params":[1,[["place2",0,[1,1]]],173199866315710],"hash":"13210760e20de99b8218be5cc465851fcb6aa74a"}',
//data: "{'jsonrpc':'2.0','method':'getPostList','id':1,'params':[1,[['place2',0,[1,1]]],173099135176724],'hash':'decfe7c9183f16efa1291f5131902f7d4ef4ff14'}",
cache: false,
processData: false,
success: function(msg) {
if (msg.d != "")
alert('salam');

            },
            error: function(xhr, errorType, exception) { //Triggered if an error communicating with server  
                var errorMessage = exception || xhr.statusText; //If exception null, then default to xhr.statusText  

                alert("There was an error creating your contact: " + errorMessage);
            }
        });
    }

</script>

I get this error now : There was an error creating your contact: NetworkError: Failed to execute 'send' on 'XMLHttpRequest': Failed to load 'http://tehran.divar.ir/'.

[thatraja]

For different domain, you should use JSONP[^] EDIT

---

Someone posted a blogpost here on this topic, check it out Using jQuery Binding to make cross-domain calls with Closure Callbacks[^]

thatraja

Code converters | Education Needed | Improve EverythingNew