To recursively fetch urls from profile page

[firesofmay]

To be able to fetch urls from friends urls and do this recursively.
A -> B friend of A
-> C friend of A
-> D friend of A

fetch A
get url links for B, C, D

fetch B
get friends link for B (E, F, G)

fetch C
get friends link for C (H, I, J)

fetch D
get friends link for D (K, L, M)

now go to E
and repeat
fetch E
get friends link for E (....)

till either user's max input or till all finished

Also make sure fetching friends process is abstract enough to in-corporate any changes of how we will store data of profile pages later.

[firesofmay]

Algorithm

1. Take first URL input from user
2. write it to a tempfile
3. read one url from tempfile
   3.1) if url found goto 4 else goto 10
4. fetch page for that url
5. extract name and friends link from that page.
6. write the data to a new file by its link as name
7. append his friends link to the tempfile.
8. delete current url from tempfile.
9. Goto step 3
10. exit

This algorithm should be easy to implement.

[firesofmay]

Deadline - To Finish this module by 18th August 2011.

[firesofmay]

I am able to fetch data recursively.
Each profile data is stored in a file with extension .fbd (facebook data)
Well I wanted to create my own extension file :)

It is able to break the infinite loop where
if A is in B's friends list
& B is in A's friends list in public data.
In that case the program was going in infinite loop.

To avoid such cases, if A's public data is already available, skip A.
This breaks Infinite loop.

Now the issue is to fetch extra data to continue the iteration of the loop.

[firesofmay]

Although I am able to do this. The code is getting larger and larger and its gonna get complicated, I can see it already...

I need to switch to OO design concepts to handle the modules properly....
Will take some Time...Will try switching all the code to OO by sunday 21st ..