David Brown, Elizabeth Judge
Take a trip to New York and see the city from the air
Every aspect of computer users’ lives — from their heartbeat to a guilty smile — could be monitored and immediately analysed under the futuristic system detailed in Microsoft’s patent application.
Details of the planned “Big Brother” system are revealed in an application to the US Patent and Trademark Office, seen by The Times, over seventeen pages of text with ten diagrams.
The systems work not only through desktop or laptop computers but even through mobile phones or handheld PCs, meaning that even out of the office the employee can still be monitored. In its most advanced format, the system will monitor users’ private interests.
The system works by recording and analysing what words and numbers are used or websites visited, and by watching the user’s heart rate, breathing, body temperature, facial expressions and blood pressure. The patent application explains: “The system can also automatically detect frustrations or stress in the user via physiological and environmental sensors and then offer or provide some assistance accordingly.”
There is a recognition that humans can have significant differences so all users will be given a “baseline” for normal physiological readings based on their body type and personality in recognition that these could affect their physical or emotional responses.
The patent gives the example of “an elevated heart rate during a tax return preparation may be considered normal for one user and not an indication that help is needed, but for another user, the inverse may be true”.
Every response will be analysed in “real time” to allow the computer to decide what action should be taken.
The patent application says: “From this data, statistics related to performance, success rate, frequency of problem, and the like, can be provided to users or can be employed to gauge a target user’s success, performance, or efficiency with respect to other users.”
One scenario given in the patent is of Joe, who is “spending more time on an activity than was originally allotted [by the system] and as a result may not meet his deadline for the project”.
The next step is for the computer to select the most suitable employees by “comparing the performance of people working on similar activities and finding the best people for those types of activities such as for future assignment”.
But the system described does more than just measure workload. It can test for honesty of those activities “performed successfully but not in accordance with company or government policies”.
Heart rates, sweating and facial expressions are already used by law enforcement agencies to detect wrongdoing. Now an employee’s laptop will be able to identify the fraudulent expenses claim or the illegal contract offer. The patent explains: “Monitoring user activity can facilitate auditing how activities are performed to look for or isolate patterns of user problems, abuse, common errors incurred by users, or to ensure company/government policies are complied with.”
The “Monitoring System 500” allows groups of users to watch and monitor each other. Microsoft says the 500 can “enhance social experiences among users by binding them or bringing them users together based on a target activity”.
As an example it can “locate people that are watching a particular TV programmes at the same time or are performing a similar activity at the same time. Discussion groups or social events can be generated as a result.”
However, Microsoft’s vision of a world where the microchip replaces the middle manager has been greeted with caution by British business.
Stephen Alambritis, of the Federation of Small Businesses, said: “We always say the best approach is the personal touch. We would urge smaller employers to err away from this kind of software. It will sour industrial relations.” David Frost, the director-general of the British Chambers of Commerce, said: “The trust that exists between employer and employee will be undermined if staff feel they are under constant surveillance.”
Ben Willmott, employee relations adviser at the Chartered Institute of Personnel and Development, said: “Our research into employees shows that where individuals feel they are under excessive monitoring or surveillance they tend to have a negative attitude towards their employer and are therefore less likely to be motivated and committed. Employers who consider introducing this need to think twice.”
Follow our three athletes' progress in their preparations for the London Triathlon, and pick up training tips and more
Enjoy screenings of all the classic films you love, plus take advantage of two-for-one tickets
We explore leisure activities that are safe and suitable for all of the family
Times Online's new TV show helps you make the right decisions for your pet
Read our exclusive 100 Years of Fleming and Bond interactive timeline, packed with original Times articles and reviews
The latest travel news plus the best hotels and gadgets for business travellers
Shortcuts to help you find sections and articles

Get Times news, business and sport on your mobile. Text Times to 86626


Overseas contacts and local business information

£129,500
Bentley Edinburgh
£79,850
Mercedes-Benz of Northampton
£26,995
Unit 1, Woodfield Business Unit, Kidderminster Road, Ombersley, Worcester.
Great car insurance deals online
90k + Bonus + Options
Confidential
London
£23,716 +
Highways Agency
National
£
£43,405 - £48,228 pa
Notting Hill Housing
London
£30,000 base, £100,000 OTE
Riches Consulting
London/South
Live in One of London's Most Vibrant Areas
From £249,950
Beautiful Gardens w/ stunning Thames Views
Studios £33K, 1 Beds £60K, 2 beds £79K
Mortgages, bank acc & money transfers to help you buy abroad
Explore mystical Jordan
From £1030 for 7nts 4*
to USA's Most Cosmopolitan City; San Francisco!
£POA
Book Now for Winter 08/09 and Get 10% off!
Great travel insurance deals online
Contact our advertising team for advertising and sponsorship in Times Online, The Times and The Sunday Times. Search globrix.com to buy or rent UK property. Visit our classified services and find jobs, used cars, property or holidays. Use our dating service, read our births, marriages and deaths announcements, or place your advertisement.
Copyright 2008 Times Newspapers Ltd.
This service is provided on Times Newspapers' standard Terms and Conditions. Please read our Privacy Policy.To inquire about a licence to reproduce material from Times Online, The Times or The Sunday Times, click here.This website is published by a member of the News International Group. News International Limited, 1 Virginia St, London E98 1XY, is the holding company for the News International group and is registered in England No 81701. VAT number GB 243 8054 69.
Dear Andy from Wales - you Brits have the most extensive CCTV system in the world. The Brits spend half of their lives being video taped on streets, in buildings and on the underground. You're already the most monitored subjects in the world.
Elliot, Washington , DC
The only good to this is: The Chinese also will have the same spysystem.
Capistrano, Anduze, France
We're British. We don't like this kind of thing. Why do Bill Gates and co. think we're all going to jump at this latest means of monitoring our every move? Americans may love it; Brits, I believe, are less likely to. But, then, there's no accounting for Americans. :-)
Andy Armitage, Hebron, Whitland, West Wales, UK
It's naive to think that you can be "safe" just by using a different operating system (OS).
This technology is being developed because it is possible and there are uses for it, wether they are private, corporate, governmental or military. It is also one of the next logical steps for what exists now, computer-wise.
Therefore, it will be developed for every OS with a significant user base ((including Mac) and not that many private users can become independent from software companies.
Anyway, if companies/government/military want it, they will use it, no matter what OS they have to buy.
This is the price you pay for technology. The more you want it to do (or to do with it), the more it will control your life.
It's a brand new World and you accept it or, as Dave Nicoll wrote, start wearing your tinfoil hats 24/7.
Joaquim Amado Lopes, Lisbon, Portugal
stay off the grid.... Use Linux. Ubuntu has made it so easy
dom, smalltown,
Quick, put your tinfoil hats on! I'm shocked that The Times sensationalised this without considering the bigger pictures. And to all the people that consider this an "announcement" from Microsoft, you couldn't be more wrong. It's a patent application to develop technology.
Dave Nicoll, Leeds,
That's why I prefer a Mac. This will just make Orwell's 1984 a reality that much sooner. Oh well, even if we can't do anything about what our bosses use, we can boycott any products containing this for our personal lives. Our personal lives are just that. Personal! To quote Commander Worf: "Resistance is NOT futile". We will not be assimilated.
Larry, Indianapolis, US
The software itself is not the scarry thing, in fact it is quite interesting. I could imagine I might find it very useful to be able to monitor myself as I was doing daily activities, augmenting my senses in some sort of way. You could use the feedback to be mre effective.
The problem arrises when people use this in a surveillance capacity, to further their own goals instead of the individuals. It boils down to the same question many of these types of dicussions do: how can we make sure that the individual owns data about himself? He can then choose to share or not share parts of this data with others. Just like you choose to spend money or not.
Mark Smith, London, United Kingdom
Its funny how the liberals are doing the real spying!
And they also want to control your smoking
cellphone use
texting
how much eletricity you use in california
what kind of car you can drive
what fats you can eat
and now we are surprised that Microsoft has invented a spy on user software
that im sure China will find a use for!
Vernon, Hillsborough, USA / NC
This tendency - to control each and every aspect of human life - has always been and will always be. And we, from our own side, will always do everything possible to avoid such interference.
Whether you like it or not but it is impossible to imagine modern life without computers. One way or another you are also connected with their usage. And I'm sure that any of us would like to keep his privacy safe when using a computer. But to keep means to protect. That's why you need 3 programs to feel safe: firewall, anti-virus and anti-spyware. As for me, I use Kaspersky Internet Security 7 (firewall + anti-virus) and PrivacyKeyboard (anti-spyware).
Anhel, San-Francisco,
"Gattaca" is coming. Personally, I find Microsoft's announcement terrifying. Instead of introducing new methods to spy on an already
pressured work force, try developing management skills that motivate, encourage and reward workers for their efforts.
If the proposed "Monitoring System 500" took a hold we could see employee selection, promotion and pay based on heart rate, perspiration patterns and brow furrow.
Thereafter ,we will see the ascendancy of a non-sweaty, low blood pressured, baby faced elite that will be the only group deemed worthy of employment and work-placed responsibility.
Please ceo's, md's and champions of industry...listen to the sanity expressed by Ben Willmott, Stephen Alambritis and David Frost.
Mr. Gates, if you are reading, please, please invest your energies in making "word" perfect instead!
sean johnson, leamington spa, united kingdom
NuLabour's dream come true.
Penny Russell, Vancouver, Canada