Second-order matrices

Connect Asia Data learn, and optimize business database management.
Post Reply
kexej28769@nongnue
Posts: 325
Joined: Tue Jan 07, 2025 4:32 am

Second-order matrices

Post by kexej28769@nongnue »

facebook.com
So what’s the big deal about a 5-15% difference in links when crawling the web? Well, it turns out that these numbers are biased towards sites with lots of links that don’t have a mobile version. However, most of these links are main navigation links. When you crawl deeper, you find the same links. But the ones that deviate have radically different second-level crawl links.


Now this is where the data gets interesting. As we continue to crawl the web using crawl sets that are influenced by links discovered by mobile bots versus desktop bots, we will continue to get australia number data different results. But how far will they go? Let’s start with size. While we crawled the same number of homepages, the second-tier results varied based on the number of links found on those original homepages. So, the mobile crawl set was 977,840 unique URLs, while the desktop crawl set was 1,053,785. Already we can see a different index taking shape – the desktop index is much larger. Let’s dig deeper.



I want you to take a moment and really pay attention to this graph. Notice that there are three types:

Mobile Unique: Blue bars represent unique items found by the mobile bot.
Desktop Unique: Orange bars represent unique items found by the desktop bot.
Shared: Gray bars represent objects found by both.
Also remember that there are four tests:
Post Reply