Comments on: How to build a Crawler http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/ Utterly random, incoherent and disjointed rants and ramblings... Wed, 19 Nov 2008 17:18:39 +0000 http://wordpress.org/?v=2.0.5 by: Wikke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3123 Wed, 28 Feb 2007 17:51:02 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3123 Jup, You're about right! The biggest two are fighting each other for us, poor customers :p. There are some more broadband providers, but they are just too small. And they use the systems of the bigegst two, so their prices aren't that smaller (or you just have less service or etc..). Jup, You’re about right!
The biggest two are fighting each other for us, poor customers :p.
There are some more broadband providers, but they are just too small. And they use the systems of the bigegst two, so their prices aren’t that smaller (or you just have less service or etc..).

]]> by: Luke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3119 Wed, 28 Feb 2007 15:28:11 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3119 Oh wow. That totally sucks. Let me guess - you guys have 1 or 2 teleco companies monopolizing the market, and setting the prices the way they want? I have seen this happening in Poland. We had one huge Telecom which was socialized, centralized and funded by government. Then they privatized it, and you now had this huge, publicly traded behemoth which owned 90% of the infrastructure in the country. Kinda like the Microsoft of ISP's. :P This is why it is nice to live in New Jersey. :) I can essentially pick between 3 different cable providers in my area, and 3 or 4 different DSL companies. And I'm not even in a big city - just the suburbs. Oh wow. That totally sucks. Let me guess - you guys have 1 or 2 teleco companies monopolizing the market, and setting the prices the way they want?

I have seen this happening in Poland. We had one huge Telecom which was socialized, centralized and funded by government. Then they privatized it, and you now had this huge, publicly traded behemoth which owned 90% of the infrastructure in the country. Kinda like the Microsoft of ISP’s. P

This is why it is nice to live in New Jersey. ) I can essentially pick between 3 different cable providers in my area, and 3 or 4 different DSL companies. And I’m not even in a big city - just the suburbs.

]]> by: Wikke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3115 Wed, 28 Feb 2007 09:16:59 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3115 Apparently, you don't live in Belgium. The average bandwidth a customer gets is about 10Gb/month. If you transfer more, you have to pay a lot or continue surfing at 64Kbps :( Nowadays, I see more and more movies, but these are either rented or in a cinema. Apparently, you don’t live in Belgium.
The average bandwidth a customer gets is about 10Gb/month. If you transfer more, you have to pay a lot or continue surfing at 64Kbps (
Nowadays, I see more and more movies, but these are either rented or in a cinema.

]]> by: Luke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3106 Tue, 27 Feb 2007 17:11:04 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3106 You don't need cable to watch movies and TV shows these days. All you need is an internet connection, and some bandwidth to burn. ;) You don’t need cable to watch movies and TV shows these days. All you need is an internet connection, and some bandwidth to burn. )

]]> by: Wikke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3105 Tue, 27 Feb 2007 07:16:13 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3105 When I was a kid, I allmost never saw any movies at all :) We don't even hav cable tv at my parents house :) and that in a country where >99% of the people have cable :) But I don't regret it. Most of it is junk anyway. When I was a kid, I allmost never saw any movies at all )
We don’t even hav cable tv at my parents house ) and that in a country where >99% of the people have cable )
But I don’t regret it. Most of it is junk anyway.

]]> by: Luke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3104 Mon, 26 Feb 2007 18:15:15 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3104 <blockquote>but i’ve never seen a star wars movie</blockquote> :shock: Wow! Really? If you ever plan watching them, see the old ones, and skip all the prequels. They suck.

but i’ve never seen a star wars movie

shock Wow! Really? If you ever plan watching them, see the old ones, and skip all the prequels. They suck.

]]> by: Wikke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3103 Mon, 26 Feb 2007 18:00:57 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3103 I did know what the crawler was about, but i've never seen a star wars movie, so yeah, I couldn't connect the two :) Thanks for the explanation! I did know what the crawler was about,
but i’ve never seen a star wars movie, so yeah, I couldn’t connect the two )

Thanks for the explanation!

]]> by: Luke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3100 Mon, 26 Feb 2007 14:36:00 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3100 Ok, here is the explanation: One guy asks about what is the best language for building a "web crawler" - a piece of software that you can use to scrape the web for information. Search engines use web crawlers to build their indexes. The other guy responds Jawa - the language of sand people from Star Wars who hunt for droids and cruise around with a ginormous "sand crawler". Jawa sounds just like Java so the joke works on both levels. I think a non-native speaker should be able to get it, as long as you are able to make the Star Wars connection. Ok, here is the explanation:

One guy asks about what is the best language for building a “web crawler” - a piece of software that you can use to scrape the web for information. Search engines use web crawlers to build their indexes.

The other guy responds Jawa - the language of sand people from Star Wars who hunt for droids and cruise around with a ginormous “sand crawler”. Jawa sounds just like Java so the joke works on both levels.

I think a non-native speaker should be able to get it, as long as you are able to make the Star Wars connection.

]]> by: Wikke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3099 Mon, 26 Feb 2007 11:47:13 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3099 I don't get it... Can someone explain this to a no-native-english speaker? It has something to do with Java, right? I don’t get it…
Can someone explain this to a no-native-english speaker?
It has something to do with Java, right?

]]> by: Luke http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3098 Mon, 26 Feb 2007 02:46:57 +0000 http://www.terminally-incoherent.com/blog/2007/02/25/how-to-build-a-crawler/#comment-3098 Is that a good groan or a bad groan :) Is that a good groan or a bad groan )

]]>