New InSites into the FAST Search Engine

The Unique Place of FAST in Search Landscape

When most people think of web search, they picture the dominant players that surface the biggest headlines. But beyond the obvious giants, a smaller engine - FAST - holds a surprisingly influential position. FAST, the engine behind alltheweb.com, differs from typical search platforms in two core ways. First, it operates as both an independent search engine and a powerful backend for other portals. Second, it treats indexing and ranking with a distinct balance between technical infrastructure and content signals.

FAST’s partnership network is a testament to its flexibility. While many engines build their own proprietary crawlers, FAST’s model is built on integration. By acting as a data provider for dozens of portals, it ensures that the same high‑quality index supports varied front‑ends. This dual capability means that if a portal’s own ranking rules shift, the underlying data set remains stable, giving site owners a consistent performance baseline.

For businesses operating in multiple regions, FAST’s role expands further. In the United States, FAST supplies search results to Lycos, Telus, and AllTheWeb itself, covering roughly 35 percent of domestic queries. In Europe, the engine’s reach surpasses 75 percent of searches, feeding the likes of Lycos Europe, Terra, T‑Online, Tiscali, and Excite.it. These numbers translate into over 70 active portals in the continent, placing FAST at the heart of cross‑border search traffic.

Such extensive coverage explains why marketers target FAST: a single partnership can unlock visibility across a network of portals that reach millions of users. However, this power comes with responsibility. FAST maintains strict controls over the quality of its index, balancing aggressive crawling with mechanisms designed to deter spam. The result is a more curated experience for end‑users and a higher standard for site owners who want their content to appear.

FAST’s internal engine also demonstrates a nuanced approach to ranking. While link analysis remains a key driver, the system places particular emphasis on static and dynamic ranking factors. Static rank derives from the web’s link graph, while dynamic rank is shaped by keyword relevance and on‑page content quality. By weaving these signals together, FAST delivers results that feel both authoritative and contextually relevant.

In addition to its technical attributes, FAST’s corporate culture prioritizes partnership and innovation. The company’s leadership, represented by figures such as Stephen Baker - Director of Business Development and Marketing - actively engages with the SEO community, offering insights on best practices and upcoming changes. This openness has earned FAST a reputation as a collaborative partner rather than a closed system.

Overall, FAST occupies a unique niche. It provides a robust, multilingual index, powers a broad array of portals, and offers a distinctive ranking philosophy. For site owners looking to expand their reach, understanding FAST’s dual role and partnership model is essential for navigating the search ecosystem effectively.

FAST’s Dual Role: Powering Partners and Running Its Own Engine

While FAST serves as a backend for numerous portals, it also operates its own public search engine through alltheweb.com. This duality distinguishes it from other search solutions that rely solely on third‑party access. By controlling both the crawling infrastructure and the front‑end experience, FAST can fine‑tune features that benefit both partners and direct users.

The alltheweb.com portal acts as a testing ground for new functionalities. Before rolling out improvements to partner engines, the team evaluates their impact here. Recent developments include dynamic content indexing and support for 48 languages, with an index that now covers over 700 million full‑text HTML pages. The system uses query analysis to remember user preferences, which promises a more personalized search experience in future releases.

Submitting a site to FAST is straightforward. Unlike Inktomi, where partners must go through a complex submission process and pay a fee, FAST allows direct addition via the Add URL page at alltheweb.com/add_url.php. Site owners can immediately see how their pages appear in the index and adjust metadata or content accordingly. For partners who need deeper control, FAST offers advanced submission options that let you list every page that must be indexed. This ensures critical content isn’t missed during the crawl.

Partners such as Lycos use FAST’s core engine to power their own search services. The Lycos InSite program, for instance, guarantees inclusion within 48 hours of submission and provides a yearly guarantee of index presence. Subscribers receive personalized reports and access to Search Services Central, an online dashboard where they can monitor indexing status, update URLs, and request support.

Paid inclusion is a distinguishing feature. By paying a flat fee plus a per‑URL cost, site owners lock in a spot in the FAST index and gain a guaranteed refresh schedule. The cost structure - $18 per year plus $12 per URL - provides an affordable entry point for small sites. Larger businesses can opt for more comprehensive packages, such as PartnerSite II or III, which include FAST‑hosted onsite search engines and monthly billing up to $279.

When a site is too large for the standard partner package, FAST’s XML integration comes into play. Using a custom Document Type Definition (DTD), developers can feed an XML feed that lists pages explicitly, bypassing the crawler’s discovery phase. This method is especially useful for database‑driven sites or those that rely heavily on dynamic content. By providing the exact URLs, the crawler fetches the page content without having to navigate the site’s link structure.

Beyond technical features, FAST’s partnership approach offers a strategic advantage. By aligning with multiple portals, a site gains exposure across different audiences without duplicating marketing efforts. For instance, a product page indexed on Lycos Europe automatically appears for users across all Lycos‑powered portals in that region, maximizing reach with minimal effort.

Ultimately, FAST’s combination of an open, public search engine and a powerful backend for partners gives it a flexible edge. Site owners can choose the level of control that suits their needs - direct submission for quick inclusion, paid inclusion for guaranteed visibility, or XML feeds for large, dynamic sites - while benefiting from FAST’s robust crawling and ranking system.

Inclusion Options and Spam Policies: How to Get Your Site Indexed

Getting a website indexed by FAST is easier than many think, but it requires an understanding of the engine’s policies and available services. Fast offers both free and paid inclusion methods, each with its own advantages and caveats. Knowing which path to take depends on your site’s size, content type, and marketing goals.

The free submission route remains active and is suitable for small sites or those wanting a quick test. Once you submit a URL via alltheweb.com/add_url.php, FAST typically crawls the page within two to six weeks. However, this window can widen because a staggering 95 percent of free submissions turn out to be spam. Spam detection algorithms filter out the majority, leaving the system to focus on legitimate content. The result is a slower, less predictable refresh rate for the remaining sites.

In contrast, the paid inclusion program - PartnerSite - provides a guarantee. By paying a modest fee, you secure a spot in the FAST index for an entire year, with a guaranteed refresh every 48 hours or less. The program’s tiers accommodate businesses of all sizes: from the basic Pay‑Per‑Page option at $18 annually plus $12 per URL, to higher‑tier packages that include onsite search tools and deeper indexing. These packages also provide advanced reporting and direct access to support, allowing site owners to monitor performance and troubleshoot issues efficiently.

FAST’s spam policy is rigorous. The engine classifies spam into three categories: page spam, which includes link farms and other artificial link building; spam stuffing, where keyword stuffing and invisible text are used; and offensive content, which is flagged but not necessarily penalized as spam. Sites that land on the spam list can be removed from the index, but the process is case‑by‑case. Fast emphasizes the importance of maintaining a clean hosting environment; servers flagged as spam should be avoided to reduce the risk of banishment.

When you submit a site, FAST evaluates both the server’s reputation and the content itself. If the server has a history of spam activity - an estimate of 20 million blacklisted servers worldwide - your site is more likely to be flagged. A unique IP address can help mitigate this risk, separating your site from the broader server’s history. Even if you’re hosting on a shared platform, ensuring your site adheres strictly to FAST’s guidelines - no excessive redirects, no hidden text, proper use of meta refresh tags - reduces the likelihood of penalties.

For sites that need to transition to a new domain or restructure URLs, Fast advises the use of meta refresh tags instead of JavaScript redirects. The engine’s crawler respects meta refresh, ensuring search engines recognize the new location and transfer ranking signals. If JavaScript is unavoidable, the team suggests providing clear alternate links or using XML sitemaps to convey the updated structure.

PartnerSite IV, a higher‑tier option, allows bulk inclusion via XML feeds. This is especially handy for large catalogs or dynamic pages that require precise indexing. The XML feed follows a custom DTD, which instructs the crawler to fetch specified pages directly rather than discover them through link traversal. For sites with complex navigation or database‑generated content, this method ensures all important pages are indexed without overloading the crawler.

Beyond technical submissions, FAST encourages site owners to focus on quality. The engine’s ranking logic values authoritative content that naturally attracts links from credible sources. If a site is well‑written, unique, and includes relevant keywords, it’s more likely to earn a higher static rank. Regularly updating content and ensuring the site remains fresh - through server‑side includes or frequent blog posts - can give a subtle ranking boost.

In sum, FAST offers a spectrum of inclusion options. Free submission is low‑risk but slower, paid inclusion guarantees speed and visibility, and XML feeds cater to large, dynamic sites. Regardless of the method chosen, adhering to spam guidelines, maintaining a clean hosting environment, and producing high‑quality content remain the keys to successful indexing.

Rising Above on FAST: Ranking Dynamics and Practical SEO Tactics

Understanding how FAST ranks content is crucial for any site owner aiming to climb the search results. The engine balances two main ranking components: static rank, driven by link popularity, and dynamic rank, influenced by keyword relevance and on‑page content quality. By optimizing both, you can position your site to achieve higher visibility.

Link popularity remains the engine’s most influential factor. FAST’s algorithm rewards inbound links from authoritative domains, but it does not consider internal linking as a source of link score. This design keeps link building efforts focused on external partnerships rather than in‑site navigation. For a site lacking external backlinks, FAST’s ranking may suffer, even if the content is excellent. Therefore, cultivating relationships with reputable sites in your niche - through guest posts, collaborations, or industry directories - can provide the necessary boost.

Dynamic rank hinges on how well a page aligns with the user’s search intent. This includes keyword usage, metadata accuracy, and overall content relevance. FAST evaluates pages on a per‑page basis; a high link score for one page does not automatically elevate the entire site. Consequently, you should treat each page as a separate entity, ensuring that titles, meta descriptions, headers, and body copy contain the targeted keywords naturally.

Because FAST also incorporates query analysis, the engine tracks user interactions over time. If users frequently return to certain results or filter for specific terms, FAST learns to prioritize those pages. While the specifics of this learning process are proprietary, the outcome is a more personalized ranking that reflects real user behavior. Site owners can indirectly influence this by encouraging user engagement - adding clear calls to action, improving page load times, and ensuring a mobile‑friendly experience.

Freshness is another subtle factor. When two pages share identical content, the newer one tends to receive a slight ranking edge. Fast’s crawling schedule can refresh a site every 48 hours for paid inclusion customers, giving those pages a chance to stay current. For free submissions, the refresh is less predictable, so maintaining a schedule of regular updates can keep the content aligned with the latest trends and user expectations.

One practical tip is to segment your site’s content strategically. If your business covers multiple topics, consider creating dedicated pages that each focus on a distinct keyword cluster. This approach allows you to target specific queries without diluting relevance. It also enables you to build authoritative signals around each cluster, increasing the likelihood of high link scores for individual pages.

To maintain a clean standing with FAST, avoid practices that trigger spam detection. Overuse of redirects, especially those that mask content changes, can raise red flags. Similarly, keyword stuffing, hidden text, or deceptive meta tags should be eliminated. If you need to change a page’s URL, use a 301 redirect and submit the new link to FAST to preserve link equity.

For sites on the paid inclusion path, the guarantee of indexing provides a strategic advantage. By regularly submitting new content - whether blog posts, product pages, or case studies - you can keep the crawler aware of fresh material. This consistent activity, combined with a focus on quality backlinks, sets a solid foundation for higher rankings.

Finally, monitor your performance through FAST’s reporting tools. By tracking click‑through rates, impressions, and position changes, you can identify which strategies yield the best return. Adjust your keyword targeting, tweak meta descriptions, or invest in new backlink opportunities based on data-driven insights.

By aligning your content strategy with FAST’s ranking philosophy - prioritizing authoritative links, delivering relevant and fresh on‑page content, and respecting spam guidelines - you can elevate your site’s presence across the network of portals that FAST powers.