Jonathan Richards
Win a £1500 Raymond Weil watch
Jimmy Wales, the founder of Wikipedia, has said that just as internet users can contribute to articles on an open-source encyclopedia, so too will they be able to play a hand in the way the web is searched.
Mr Wales said that his open-source search engine, which will let users influence the ranking of search results, should be released by the end of the year. The engine will also allow users' computers to help crawl the hundreds of millions of pages on the web, indexing the content of each.
A key component of the architecture of Search Wikia, as the project is called, is now in place, Mr Wales said, enabling users to download a piece of software to let individual computers crawl a small section of the web.
The idea is that the combined power of thousands of small machines indexing the web could outweigh the searching ability of the vast, centralised crawlers that sit behind engines such as Google's and Yahoo!'s.
"When I opened Wikipedia with only three articles in it, it was a pretty bad encyclopedia," Mr Wales told the Washington Post. "That's where we're going to be in December with the search engine. We'll tell people upfront: 'It's not very good yet.' But we'll open it up to get feedback and community involvement to help us make it better."
Search Wikia would crawl the web more quickly and efficiently than a traditional engine, he said, but it would also offer opportunities, "at various points along the search process, for people to engage, join and participate in the construction of the search results."
Participating users might, for instance, be able to tag sites using keywords and links that would work in conjunction with traditional algorithms to 'map out' the web in a more human way.
The engine would also expose the workings of the algorithm it used to rank pages in the interests of "openness and transparency", Mr Wales said. Traditionally search engines have kept their algorithms secret.
Mr Wales told a conference of developers in Portland, Oregon, that Wikia, the start-up behind the project, has recently acquired Grub, a pioneering web crawler which would be opened up to the software community to make improvements.
LookSmart, the San Fransisco-based firm from which Wikia bought Grub, had agreed to deliver ads to Search Wikia when the engine launched, he said.
Not everyone has expressed enthusiasm for human-based search. Danny Sullivan, one of the editors of the 'Search Engine Land' blog, has said that a "human element" was crucial to the early success of Ask Jeeves, for instance, but that scaling quickly became a problem, and that "over time the machine has reigned supreme."
A comment on the Search Wikia blog said that an open-source search engine would be much more prone to abuse than a site such as Wikpedia, because the potential for for "bad guys" to exploit it for commercial gain was that much greater.
Smaller search engines that are struggling to compete with the larger providers should join the project, Mr Wales said. "A lot of second-tier players understand that competing with Google directly as independent proprietary projects, they'll never catch up," he said. "By banding together using open-source software, they can effectively compete with Google and improve their services."
Wikipedia, which was co-founded by Mr Wales, is operated by the Wikimedia Foundation, a charitable organisation. The search engine 'Search Wikia' is being launched by Wikia, a private company unrelated to Wikimedia which was set up by Mr Wales in 2004.
Industry sectors news at a glance. Interactive heatmap, video and podcast
Everything the Business Traveller needs to know to make a better trip
Get ready for the winter sports season, with our resort guides and snow reports
We are backing British business, what is the confidence of the nation and what businesses are succeeding?
Growing demand for energy, oil that is harder to reach and the rise of carbon dioxide emissions. We examine the energy challenge
With rail travel in Europe on the rise, we review the benefits of travelling by train
In this special section we explore new food trends to help improve your dinner party and impress guests
Enjoy further reading from Travel to Fashion, Business to Sport, discover more
Shortcuts to help you find sections and articles
1998
£47,955
2004
£56,950
Essex
Check your free Experian credit report before applying
Car Insurance
£100,000
Barnardos
UK
£123,460 pa
The Law Commission
London
Hampshire County Council
Competitive + bonus + benefits
Manchester United
Central London
Moments from Battersea Park.
For sale with Winkworth
Find out about shared ownership.
See your free Experian credit report beforehand
Includes flights, accommodation with room upgrades, transfers city tours in Hong Kong and Bangkok.
PremierHolidays.co.uk
For your ultimate tailor-made ski holiday, click here
Get covered on your travels with a superb range of policies at great prices. Visit InsureandGo.com
Choose from the beautiful landscape and tranquil beaches of Oahu, Kauai, Maui & Big Island.
Contact our advertising team for advertising and sponsorship in Times Online, The Times and The Sunday Times, or place your advertisement.
Times Online Services: Dating | Jobs | Property Search | Used Cars | Holidays | Births, Marriages, Deaths | Subscriptions | E-paper
News International associated websites: Globrix Property Search | Milkround
Copyright 2009 Times Newspapers Ltd.
This service is provided on Times Newspapers' standard Terms and Conditions. Please read our Privacy Policy.To inquire about a licence to reproduce material from Times Online, The Times or The Sunday Times, click here.This website is published by a member of the News International Group. News International Limited, 1 Virginia St, London E98 1XY, is the holding company for the News International group and is registered in England No 81701. VAT number GB 243 8054 69.