Help required for Research

[Dan Kaminsky]

On Mon, Mar 22, 2010 at 4:41 PM, Nitin Mohan <mohanni at onid.orst.edu> wrote:

> Quoting Keisial <keisial at gmail.com>:
>
>
>> Laborious?
>>
>> for n in `seq 1 100`; do
>> wget "https://bugzilla.mindrot.org/show_bug.cgi?ctype=xml&id=$n" -O
>> bug_$n.xml
>> done
>>
>> Replace 100 with the number of bugs to parse, bugzilla.mindrot.org with
>> the bugzilla you want to crawl.
>>
>> You can speed it up reusing the same connection:
>> (for n in `seq 1 100`; do
>> echo "https://bugzilla.mindrot.org/show_bug.cgi?ctype=xml&id=$n"
>> done) | wget -i - -O bugs.xml
>>
>> (that generates a concatenation of xmls, may work for your scripts or
>> may need some preprocessing)
>>
>>
> Wow! Thats a great suggestion. Will definitely try that out. Just the kind
> of suggestion I was looking for.
>
> Thanks for the help.


Well, I wouldn't let that go too fast, might kill the server :)