A Mechanical Turk

Amazon Mechanical Turk: The Digital Sweatshop by Ellen Cushing

Utne Reader, Jan-Feb 2013

The Turk or Mechanical Turk or Automatron[1] Chess Player was a hoax of the late 1700s. The Turk was in fact a mechanical illusion that allowed a human chess master hiding inside to operate the machine.

“The funny thing about the biggest shift in production in years is that almost nobody knows it happened. Which makes sense, if you think about it: It occurred invisibly, online, anonymously, all over the world, but at the same time, nowhere in particular. And it’s poised—if most people who know about it are to be believed—to completely change the way we think about work, the way we consume technology, and the way the global economy functions.

It’s called microtasking[2], and it works by outsourcing small, virtual tasks to an army of online workers, who then perform them for pennies. These tasks vary widely in scope and substance, but what links them all is that they’re essentially too difficult or too dependent on human analysis for a computer to do, but too simple for skilled labor. And they’re the bedrock of the internet.

Crowdsourced[3] microtasking—conducted largely via Amazon.com’s Mechanical Turk site—is now a multimillion-dollar industry, and one that doesn’t appear to be slowing down anytime soon. Even as the global economy continues to falter, Turk is thriving, due in no small part to what it can do for companies under pressure to do more with less.

“There’s this sort of competitive insanity of the business environment,” said Six Silberman, a longtime observer of the field who helped create a forum, Turkopticon, for people doing this kind of work. “And everyone’s trying to cut costs as strenuously and as rapidly as possible.” In a globalized economy, that’s easy to do: Mechanical Turkers—even those who live in the U.S.—make somewhere around $1.50 an hour on average, enjoy no worker protections, and have no benefits.”

Read more at Utne Reader.

 Bezos describes the work as “artificial artificial intelligence”. Hence the nod to the Mechanical Turk.

It’s not only being used to add a few bucks to people’s income, it’s being used to replace a lost job.

Laws don’t exist to cover this type of work.

The output of a Turker can be rejected for any reason and the Turker gets no feedback, just the rejection.

This is another commercialization of the trend begun by open source projects[4] in the world of programming.

It’s touted as a revolution as important as the industrial revolution and the future for the Internet.

In my opinion, it’s a trend headed in exactly the wrong direction. It’s the industrial revolution on steroids – hierarchy, segmentalism, exploitation, fragmentation, purposelessness, siloing, soullessness and all the other ills we should be trying to get away from. It like the Mechanical Turk is a fraud, a cruel hoax, perpetrated on the people.

---

[1] “An automaton is a self-operating machine. The word is sometimes used to describe an old-fashioned robot, more specifically an autonomous robot.” Wikipedia

[2] “Microtasking is the act of breaking a large project into tiny, well defined tasks. The resultant microtasks are proposed to a crowd and are characterized because: it can be performed independently, it requires human participation or intelligence (so it cannot be performed automatically by a computer) and because it can be done in a short period of time. Some experts, like Sharon Chiarella, vice president of Amazon Mechanical Turk, indicates that this “short period” should be less than an hour.”  Crowd Sourcing Blog

[3] “Crowdsourcing is a process that involves outsourcing tasks to a distributed group of people. This process can occur both online and offline. Crowdsourcing is different from an ordinary outsourcing since it is a task or problem that is outsourced to an undefined public rather than a specific body. Crowdsourcing is related to, but not the same as, human-based computation, which refers to the ways in which humans and computers can work together to solve problems. These two methods can be used together to accomplish tasks.” Wikipedia

[4] “In production and development, open source is a philosophy, or pragmatic methodology that promotes free redistribution and access to an end product's design and implementation details. Before the phrase open source became widely adopted, developers and producers used a variety of terms for the concept; open source gained hold with the rise of the Internet, and the attendant need for massive retooling of the computing source code. Opening the source code enabled a self-enhancing diversity of production models, communication paths, and interactive communities. The open-source software movement arose to clarify the environment that the new copyright, licensing, domain, and consumer issues created.” Wikipedia

All Together Now (or, Can Collective Intelligence Save the Planet?)

MIT Sloan Management Review

An interview with Thomas Malone

April 23, 2009

MIT Sloan School professor Thomas Malone addresses the mental models that impede management progress, the role of collective intelligence in solving climate problems, and his view of how wrong people are about what business is for.

Even before launching the MIT Center for Collective Intelligence, Thomas Malone was trying to imagine how work could one day be done differently. A professor at the MIT Sloan School of Management, he was a founding co-director of the Initiative on Inventing the Organizations of the 21st Century, and in general has continuously explored how “to help society take advantage of the opportunities for organizing itself in new and better ways made possible by technology.”

Some of those ways offer interesting paths to sustainability—but the paths are to sustainability as Malone defines it, which doesn’t mean a world in which everything is built to last. “It’s often the case that good things are sustainable, but sometimes things are sustainable but not good,” he says. “And sometimes things are good but not sustainable.”

In this installment of the MIT Sustainability Interview series, Malone addresses the mental models that impede management progress, the role of collective intelligence in solving climate problems, and his view of how wrong people are about what business is for. He spoke with MIT Sloan Management Review Editor-in-Chief Michael S. Hopkins.

More

A Market Intelligence System

Intelligence
While there is considerable debate as to what constitutes intelligence in humans and about the various types of intelligence that have been discovered, there is little debate as to what constitutes intelligence in and for the systems humans build. Intelligence is any form of information that improves decision making. An intelligence system is an organized way to collect and create intelligence.

Information exists in a spectrum from noise to wisdom. How can noise be information? It’s just information that we don’t consider new or relevant to our current status. Intelligence generally increases as the quality of information is moved from noise to data to knowledge to wisdom. Data is information that is new and relevant to the purpose of the intelligence system. Data is identified in the sea of noise and extracted for analysis. Knowledge is understanding obtained by analysis of the data. And, wisdom, characterized by judgment, insight of the present or past, or foresight of the future, is created through synthesis of the knowledge.


Where is the wisdom we have lost in knowledge?
Where is the knowledge we have lost in information?
T. S. Eliot, The Rock

Types of Intelligence
There are two times of intelligence:

Strategic: A strategy describes how the vision, mission and goals of an organization are to be reached. Strategic intelligence includes actionable information that affects the vision, mission and goals of the organization. The time horizon on strategic intelligence has to be at least as long as the time it takes to implement decisions reached from the strategic intelligence to achieve the desired outcome.

Tactical: A tactic describes the organization’s plan to utilize its resources. A tactic supports a strategy. Tactics often relate to small-scale actions serving a larger purpose that are made or carried out with only a limited or immediate end in view. Tactical intelligence therefore contains actionable information that affects the resource plans of the organization including its processes and procedures. The time horizon on tactical intelligence has to be at least as long as it will take to implement the decisions resulting. The tactical time horizon is shorter than the strategic time horizon.

Focus of Intelligence
The role of strategy is to obtain the optimum balance of four elements – market opportunities and threats, stakeholder desires, organizational capabilities and organizational capacities. Tactics focuses on the organization’s capabilities and capacities in order to mesh with the goals established by the strategy. This can provide a useful framework for intelligence systems.


Within the market there are driving forces, technology, competition and customers. There are six types of driving forces at work within a market: demographic, social, economic, political, environmental and technological. The impact of technology shows up twice in this description of a market. Technologies can be embedded, supportive or enabling of a product or a service to provide increased value for customers and comparative advantage. Technology as a driving force interacts with the other driving forces to create strategic shifts in the market.
















The type and focus of intelligence systems can be combined to create a table of actual and potential intelligence systems.


An organization has projects, resources and culture. And within resources there are categories: capital, people, facilities, knowledge, tools & equipment, and partners.





Descriptions of Intelligence
Customer Intelligence: Customer intelligence is the process of gathering, analyzing and exploiting information of a company’s customer base. It helps the company create a customer focused marketing process. Customer intelligence is core to the rapid innovation, promotion and distribution of new products. A company’s customer base and the information that the company has on its customers is a valuable asset that can give it a comparative advantage. When you have a high definition view of your customers, you can communicate more effectively and make smarter business decisions. Customer intelligence encompasses customer relation management (CRM) and quite often now involves the use of social networking and social media tools. Customer intelligence usually focuses on current customers, may include identified potential customers, but has no way to include unidentified potential customers.

Competitor Intelligence: Competitor intelligence is the purposeful and coordinated monitoring of your competitors, wherever and whoever they may be, within a specific marketplace. Your competitors are those firms which you consider rivals in business, and with whom you compete for market share. The purpose is to find out who your competitors are and what your competitors are doing.

Competitive Intelligence: Competitive intelligence goes beyond competitor intelligence to determine what your competitors will do – to strategically gain foreknowledge of your competitor's plans and to plan your business strategy to countervail their plans. As you might expect, this will involve many methods at the tactical collection level, but it will also require integration into your existing information infrastructure, analysis and distribution of the information, and finally, the calculation of business decisions on the basis of that information and its analysis. Competitive intelligence should include direct, indirect and structural competitors, but most often focuses on direct competitors, leaving the organization blind to indirect and structural competition.

Sales Intelligence: Sales intelligence (SI) refers to technologies, applications and practices for the collection, integration, analysis, and presentation of Sales information. The purpose of Sales intelligence is to support better business decision making by sales people. SI describes a set of concepts and methods to improve sales performance and decision making by using fact-based transaction information. SI is usually integrated or includes (CRM) Customer Relationship Management. Sales Intelligence systems are data-driven. Sales Intelligence is similar to Business Intelligence (BI) but is specifically designed for the use of sales people and sales managers. Sales intelligence solutions are predominantly designed for companies in the manufacturing, distribution and wholesale sectors. These are highly competitive markets, where volumes are high, margins are low. (SI) solutions provide unique insight into customer buying patterns. By automatically analyzing and evaluating these patterns, Sales Intelligence pro-actively identifies and delivers up-sell, cross-sell and switch-sell opportunities. Most good Sales Intelligence products will inform you if there's a potential customer drift issue, so you can address the situation before it becomes a problem. Unlike customer relationship management (CRM) and traditional business intelligence (BI) applications, Sales Intelligence analyses your existing sales data to pro-actively deliver actionable, relevant information.

Operational Intelligence: Operational Intelligence (OI) focuses on providing real-time monitoring of business processes and activities as they are executed within computer systems, and in assisting in optimizing these activities and processes by identifying and detecting situations that correspond to interruptions and bottlenecks. The purpose of OI is to monitor business activities and identify and detect situations relating to internal inefficiencies, opportunities, and threats. Some definitions define Operational Intelligence as an event-centric approach to delivering information that empowers people to make better decisions. OI helps quantify the efficiency of the business activities, how the IT (information technology) infrastructure and unexpected events affect the business activities (resource bottlenecks, system failures, events external to the company, etc.) and how the execution of the business activities contribute to revenue gains or losses. This is achieved by observing the progress of the business activities and computing several metrics in real-time using these progress events and publishing the metrics to one or more channels (e.g., a dashboard that can display the metrics as charts and graphs, autonomic software that can receive these updates and fine-tune the processes in real-time, email, mobile, and messaging systems that can notify users, and so on). Thresholds can also be placed on these metrics to create notifications or new events. In addition, these metrics act as the starting point for further analysis (drilling down into details, performing root cause analysis — tying anomalies to specific transactions and of the business activity). Sophisticated OI systems also provide the ability to associate metadata with metrics, process steps, channels, etc. With this, it becomes easy to get related information, e.g., retrieve the contact information of the person that manages the application that executed the step in the business transaction that took 60% more time than the norm, or view the acceptance/rejection trend for the customer who was denied approval in this transaction, or launch the application that this process step interacted with.

Marketing Intelligence: Marketing intelligence is the process of acquiring and analyzing information in order to understand the market (both existing and potential customers); to determine the current and future needs and preferences, attitudes and behavior of the market; and to assess changes in the business environment that may affect the size and nature of the market in the future. Social networks and social media are being used to assist in this endeavor.

Business Intelligence: Business intelligence (BI) refers to skills, technologies, applications and practices used to help a business acquire a better understanding of its commercial context. Business intelligence may also refer to the collected information itself and the knowledge developed from this information. BI applications provide historical, current, and predictive views of business operations. Often these applications use data gathered into a data warehouse or a data mart. Occasionally the applications work from operational data. Common functions of business intelligence applications are reporting, OLAP, analytics, data mining, business performance management, benchmarks, and predictive analysis. The major thrust of business intelligence theory looks at certain factors to make high quality decisions. These factors include customers, competitors, business partners, economic environment and internal operations. As businesses open up to interact with and leverage social networking environments and tools, users, customers, partners, and suppliers are taking up important roles, each day becoming more involved in the R&D of all commercial products and services. The role of BI has to change to accommodate the people-centric methodologies in the context of an open innovation paradigm. Business Intelligence 2.0 is a term referring to a new generation of Business Intelligence software that is more proactive than reactive (the latter merely analyzing data or reports produced after the fact). The first generation of Business Intelligence analyzed information involved in business oriented decisions while the next generation helps make decisions as or before events happen. Business intelligence 2.0 works on the semantic data model, not requiring knowledge of data structures or canonical forms, enabling more collaboration and supporting a people-centric, open innovation approach. While the business intelligence approach sometimes claims it assists in strategic decision making, it has a very short time horizon.

Human Capital Intelligence: Human capital intelligence provides strategic insights for better decision-making with reference to workforce investments. Embracing an enterprise-wide HCI analytics program offers a number of meaningful operational and strategic benefits: Operational reporting is more efficient and cost-effective because the data from individual applications is integrated and accessed through a single solution. Graphically-rich information is available to the people who need to make decisions and show metric-based results. Real-time analytics demonstrate the true relationship between workforce investments and the organization's bottom-line financial, customer and operational results. Human resource practices and investments can be optimized to meet enterprise performance goals. As the value drivers are getting more complex, there is greater need to generate meaningful intelligence about the effect of HR processes on business performance. Human capital intelligence is emerging as an effective channel for organizations to understand what impacts their business and how people make a difference, thus helping them to foster efficient behavior and create more value.

Market Intelligence: Market Intelligence (MI) is the information relevant to a company’s markets, gathered and analyzed specifically for the purpose of accurate and confident decision-making in determining market opportunity, market penetration strategy, and market development metrics. Market intelligence is the systematic process of gathering, analyzing, supplying and applying information (both qualitative and quantitative) about the external market environment. Traditionally, this covers only customers and competition in both strategic and tactical areas. However, it is generally weak in the strategic time frame. Market intelligence makes heavy use of social networks and social media.

Summary
As you can see in the above graphic, the standard intelligence systems are complex, overlapping and have numerous gaps. None of the existing systems cover technology or stakeholders. And, business intelligence only covers short term economic drivers. The organization intelligence systems mostly cover only information systems, or transactional events. And, none of the systems really cover strategic organizational intelligence. Competitive and competitor intelligence only covers direct competition. Market intelligence is primarily focused on strategic intelligence. Furthermore, the existing systems focus on structured data, not free form text, audio and video.

This leaves a lot of room for future development and integration of systems.

There are numerous competitors for software systems in all of the current categories. Each offering is unique, and as a result, the mapping shown above is not inclusive.


A Market Intelligence System

We can be knowledgeable with other men's knowledge, but we cannot be wise with other men's wisdom.
Michel de Montaigne

Characteristics
A new market intelligence system, as shown in the above graphic in dotted lines, is primarily a strategic intelligence system. It covers the driving forces, customers, competition and technology. The form of the data it deals with is primarily free form text, graphics, video and audio, but it can also handle free form numbers. The concept is supported by several driving forces:
• The free information movement
• The growth of information on the Internet
• Improving general search tools and growth of special search tools
• Growth of RSS tools
• The growing appreciation of the wisdom of crowds
• Movement to collaboration and open innovation systems
• Growth of web 2.0 technologies that are enabling and encouraging customer (or user) generated content, that can be used to manipulate and format information, and that can be used to facilitate collaboration in understanding data extracted from the Internet.
• Disintermediation
• Low cost and quick turn around pressures
• The need for insight and foresight in order to make better decisions (not just data)
• The inherent power of a collaborative team of involved and engaged human minds to analyze, synthesize and judge information

Benefits
The benefits of this type of market intelligence systems are:
• Is supported by and supports the driving forces affecting organizations
• Low barrier to entry: low initial cost and low or no barriers to use
• Flexibility: easy to change focus, add new features, and answer new questions
• Scalable: works for various sized groups
• Adaptable: easily adapted to a large variety of groups and purposes
• Value increases with use

Process

It is impossible to comprehend just how much information is actually floating around the globe, but it makes the odds of information you need existing very reasonable. Finding it is the real task. You need to know where to look and how to sift through the information, recognizing what you need and discarding that which lacks value to you.
Competitive Intelligence: Create an Intelligent Organization and Compete to Win
Michelle and Curtis Cook

The process that the market intelligence system follows is the noise to wisdom model described earlier. Data is identified and extracted from the sea of noise. These data are analyzed to provide knowledge and the knowledge is synthesized to create insight and foresight (wisdom). The data is gathered in the four categories: driving forces (economic, demographic, social, political, technological and environmental), customers (current, identified potential and unidentified potential), competition (direct, indirect and structural), and technology (embedded, supporting and enabling).


The sources of the data are many. They can include the Web at large, blogs, social networks, groups, news, press releases, individual web sites, reports, articles, financial sources, bookmarks & indices, and many more. Data in the form of text, tables, graphs, audio (podcasts) and video are brought into the collaborative workspace. Most of this happens automatically and is update nearly continuously. However, the members of the collaborative are encouraged to use their own sources and to bring those data into the systems as well. Consultant reports, books, journal articles and many other sources of pertinent information can be brought into the system through web browsing, RSS readers, searches, and reading can be brought in by members. The results of conversations, interviews, meetings and internal and external conferences can also be included.


The current state of readily available software is best for the identification and extraction of data. Analysis of numerical data is best done also with software tools. But, the analysis of free form text, video and audio is still best done with the human mind. In the graphics above and below (meant only to be examples), the blocks in white are done automatically and those blue are done by people.

Data, when organized, becomes information; information, when analyzed, becomes intelligence. Based on this model, intelligence professionals usually execute on a four-phased process, or cycle: 1) they identify the intelligence needs of key decision makers across the firm; 2) they collect information about events in a firm’s external business environment from print, electronic, and oral sources; 3) they analyze and synthesize the information; and 4) they disseminate the resulting intelligence to decision makers.
Millennium Intelligence: Understanding and Conducting Competitive Intelligence in the Digital Age
Jerry Miller


As the market intelligence system matures, it learns. The data base of free form text, audio and video can be searched via keywords. Or, it can be queried in free from questions that members can respond to and a discussion created. In essence it is a complex system with emergent properties.

Wisdom is not a product of schooling but of a lifelong attempt to acquire it.
Albert Einstein

The system is easily scaled. Probably 12 people is the minimum size, and there is no upper limit. With smaller groups the effort has to be included in the members work requirements. At some point, as the group grows larger, participation will have to be incented in some way. Although for large group if there is a high degree of participation, the benefits of involvement will be obvious. It will work like any successful collaborative. Individuals put X in and get some multiple of X from involvement. The role of management of the system shifts as the number of people using the system increases. The system manager is involved when the group is small and the task becomes more editorial and administrative as the group gets large.

While the system can be operated without paying for any of the information (it’s all available free on the Internet), it may be advantageous to include some paid information, or even include a consultant or analyst as a member of the team.

Depending on the purpose, vendors or customers could be included in the team. In addition, this system could be used for research panels.

Depending on the group’s comfort with using web 2.0 tools or in collaboration in general, education and training may be required.

The key to wisdom is knowing all the right questions.
John Simone

Management has to be involved in the system at least in leading discussions of important strategic issues.

Regardless of the tools you use, the single indispensable element to CI is the human factor: the smarts, experience, and instinct that can turn huge collections of dead facts into live intelligence that plays a central part in making business decisions. The best competitive intelligence team, experts agree, is one that is distributed, involving the company’s entire workforce.
Special Report: Competitive Intelligence Smart Business Magazine, March 2001

The same can be said for market intelligence.

Success for every business, whether it’s a one-person operation or a Fortune 500 corporation, increasingly depends on a timely awareness of the rapidly changing events impacting their organizations. Yet in most corporate settings, people consistently work with massive amounts of raw data, small amounts of value-added information derived from analysis, and very little intelligence. Market intelligence reverses this traditional trend toward data and information and redirects it toward actionable intelligence.

References (Connotea)

Paul Schumann
Glocal Vantage, Inc., PO Box 161475, Austin, TX 78716
512.632.6587
http://incollaboration.ning.com, http://www.glocalvantage.com
E-Mail
Twitter: innovant2003

This work is licensed under the Creative Commons Attribution license. You may distribute, remix, tweak, and build upon this work, even commercially, as long as you credit me for the original creation as Paul Schumann, Glocal Vantage Inc, www.glocalvantage.com.

MarketIntelligenceSystem.pdf

Co-Intelligence

Tom Atlee, founder of the non-profit Co-Intelligence Institute, has written and spoken for twenty years on politics, democracy and cultural transformation. His two resource packed websites – www.co-intelligence.org and www.democracyinnovations.org – capture his innovative thinking and provide a treasure-trove of resources about collective process and participatory democracy. His recent book, The Tao of Democracy, www.taoofdemocracy.com, describes his concept of co-intelligence and offers an amazing compilation of initiatives that highlight how citizen dialogue and deliberation are powerful ways to help us solve our common problems

Healthy communities, institutions and societies -- perhaps even our collective survival -- depend on our ability to organize our collective affairs more wisely, in tune with each other and nature.

This ability to wisely organize our lives together -- all of us being wiser together than any of us could be alone -- we call co-intelligence.

Co-intelligence is a capacity that goes far beyond individual IQ-based intelligence. Co-intelligence is intelligence that's grounded in wholeness, interconnectedness and co-creativity.It is collective, collaborative, synergistic, wise, resonant, heartful, and connected to greater sources of intelligence.

Co-intelligence is emerging through new developments in democracy, organizational development, collaborative processes, the Internet and systems sciences like ecology and complexity. Today millions of people are involved in co-creating co-intelligence. Our diverse efforts grow more effective as we discover we are part of a larger transformational enterprise, and as we learn together and from each other.

The Co-Intelligence Institute works to further the understanding and development of co-intelligence. It focuses on catalyzing co-intelligence in the realms of politics, governance and cultural evolution. We research, network, advocate, and help organize leading-edge experiments and conversations in order to weave what is possible into new, wiser forms of civilization.

A Market Intelligence System

A conceptual description of a market intelligence system based on web 2.0 technologies for a collaborative team.

Market Intelligence System

View SlideShare presentation or Upload your own. (tags: market intelligence)

The Numerati

The Numerati
By: Stephen Baker

Book review by 800ceoread

An urgent look at how a global math elite is predicting and altering our behavior -- at work, at the mall, and in bed.

Every day we produce loads of data about ourselves simply by living in the modern world: we click web pages, flip channels, drive through automatic toll booths, shop with credit cards, and make cell phone calls. Now, in one of the greatest undertakings of the twenty-first century, a savvy group of mathematicians and computer scientists is beginning to sift through this data to dissect us and map out our next steps. Their goal? To manipulate our behavior -- what we buy, how we vote -- without our even realizing it.

In this tour de force of original reporting and analysis, journalist Stephen Baker provides us with a fascinating guide to the world we're all entering -- and to the people controlling that world. The Numerati have infiltrated every realm of human affairs, profiling us as workers, shoppers, patients, voters, potential terrorists -- and lovers. The implications are vast. Our privacy evaporates. Our bosses can monitor and measure our every move (then reward or punish us). Politicians can find the swing voters among us, by plunking us all into new political groupings with names like "Hearth Keepers" and "Crossing Guards." It can sound scary. But the Numerati can also work on our behalf, diagnosing an illness before we're aware of the symptoms, or even helping us find our soul mate. Surprising, enlightening, and deeply relevant, The Numerati shows how a powerful new endeavor -- the mathematical modeling of humanity -- will transform every aspect of our lives.

More