Showing posts with label Media. Show all posts
Showing posts with label Media. Show all posts

Wednesday, August 12, 2020

Reverse the “Nuance Destruction Machine!”

Techonomy has just published my latest article on our social media disaster, Don’t Swim Against the Tide of “Nuance Destruction”
Social media is “a nuance destruction machine,” as Jeff Bezos concisely put it in his recent widely reported Congressional testimony.
...As long as social media’s financial incentives favor engagement (or “enragement”) over quality, its filtering algorithms will be designed to be favorable to messages of hate and fear. As long as that happens at Internet speed, bolted-on efforts to add back nuance and limit conflict will be futile. We will waste time and resources with little result, and democracy may drown in the undertow.
The article explains a two-part solution:
  1. Change the incentives.
  2. That will motivate platforms to redesign algorithms to filter for nuance — and against incivility and hate speech.
---
To go beyond the brief outline in the article, see this list of Selected Items.

Monday, May 18, 2020

The Pandemic Reminds Us "Everything is Deeply Intertwingled" – We Need Better Logics for That


A bat catches a cold in Wuhan, and weeks later the whole world coughs. America and China battle a trade war, and then there is a shortage of PPE and ventilator parts from China.  Poor neighborhoods suffer high death rates because of poor health, but even celebrities and heads of state go into ICUs.  The economy craters, and we argue over relief to businesses versus workers based on which is more disposed to misuse what they might be given.  Health officials say flatten the curve, financiers say reopen, and corporations say they don’t dare reopen without testing.  The Federal government is too polarized to fix much of anything, and has forgotten their real job of governing by consensus.  

Modern technologies of global connection -- both physical and virtual -- make the pandemic emerge in weeks instead of years, and make all the butterfly effects far more complex.  That is our new curse, but also our new blessing.  We have global travel and supply chains, global communications and media networks -- a global village composed of local villages.  Techies moved fast and broke society, and now discourse seems too polarized to fix it.

All of these effects are driven by market forces -- however regulated.  Marketplaces of goods and services and marketplaces of ideas.  These marketplaces are driven by complex interplays of top-down structure and bottom-up emergence from billions of actors --and systems of actors.  

Technology has made these forces more dynamic and turbulent, but technology can enable smarter and better-regulated marketplaces -- if we re-focus.  We cannot undo this onrushing dynamic -- we need to get smarter about how we use technology to help us go forward.

The pandemic may be the kick in the ass we need to reform society over a wide range of domains and levels.  Seeing the commonalities can help us capture a new synergy.  If rise to that challenge, the future will be bright. If we fail it will be dark.  Many see that, but few focus on the root causes. 

Peter Drucker said “The greatest danger in times of turbulence is not the turbulence, it is to act with yesterday’s logic.” Two new logics can help us correct the failures of our current logics.

Ever-growing intertwingularity

The problem we now face all too urgently is that our lives are all deeply intertwingled, but we fall back to simplistic “fast” thinking with rigid categories and institutions.  Some leaders rise to the challenge and others flail, and we argue over who does which.  The regulation of our marketplace of ideas that “mediates consent” about facts has broken down, as has our social/economic marketplace.  These problems are difficult and complex – but we can get smarter about solving them – the first order and second order effects.  (To get a sense of the range of these issues, see this briefing by Tony O’Driscoll [since adapted for publication] and this McKinsey report. To see how this has reopened old questions, and may provide an opening for new thinking, see this NY Times report on the shifting issues for the 2020 election.)
 
The symbolic circle of the Tao reminds us of that truth is never entirely black or white, but shades of gray that depend on the light we view it in and the perspective we view it from.  Just how much is subject to argument, discovery, and rediscovery, as reality emerges.  This is age-old, but it is more urgent than ever that we come to grips with it.  2020 will mark a turning point in human history.

For decades our world and our markets have been increasingly stressed, even as we seemed to be progressing.  Tensions of nationality, race, ideology, religion, economics, technology, and governance are raging.  Things fall apart; the centre cannot hold /…The best lack all conviction, while the worst / Are full of passionate intensity.”  It is now urgent that we re-center more wisely on our better convictions.

The Enlightenment has run aground because those who saw the light and had the benefits did not pay enough attention to sharing that.  Liberals turned away from “the deplorables” instead of caring for and raising them up.  Capitalists extracted short-term profits and enriched themselves with stock buybacks -- exploiting workers instead of empowering them.  Factions and political parties fought zero-sum struggles to control the existing pie instead of engaging in win-win cooperation to create and share a larger pie.

The Chinese ideograph for crisis is composed from the characters for danger plus opportunity.  Many retreat in fear of the danger and seek to throw blame and erect walls, but wiser heads look to the opportunity.  Most see opportunity in narrow domains, but some look to the big picture.  We now face an urgent and historic opportunity to refocus on a more enlightened and productive kind of cooperation across the full range of issues.

Those who see and work on these problems in particular domains of concern and expertise can unite in spirit and vision with those in other domains.  We can forge a new Age of Enlightenment – a Reformation of The Enlightenment.  An awakening of interconnection and cooperative spirit is emerging.  Our challenge is to synergize it.  Some elements:
  • Economic and health insecurity for some leads to insecurity for all.  A safety net is needed.
  • Market systems need slack to respond to black swan events.  “Just-in-time” and “lean” are efficient only when not overstressed.  Global supply chains need resilience and redundancy. Too much slack and safety drain our wealth and will, but too little lead to disaster.
  • Moving fast and breaking things can break things that cannot be fixed.  Experience can blind us, but inexperience can kill.
  • Power among local, state, national, and global government must be properly balanced and adaptable to stress.  Power and wealth must be shared fairly among people, factions, and nations, or those left wanting will throw rocks at the crystal palace.  The resurgence of nationalism, factionalism, and the crisis of disinformation are symptoms of perceived unfairness.  Government that is too small is just as bad as too big.

Our modern, high-tech world is far too complex for purely top-down or bottom-up management and governance -- we need a smart and adaptive blend. That requires openness, transparency, trust, and fairness, so even when there is disagreement, there is a common sense of reasonableness and good spirit.

New Logics for Intertwingularity

My recent work has focused on two new ways to deal better with this growing complexity.  These new logics that do not just exhort people to be better and wiser, but better align interests so that virtue is rewarded. 

One relates to failures of our marketplace of ideas – especially our social media and other collaborative systems.  Computer-augmented human collaboration first emerged in the 1960s, and was used for disaster preparedness (natural and nuclear).  It progressed slowly until the Web made it far more powerful and accessible to consumers, but we failed to direct those social media systems to serve us well.  Struggling to find a business model, they hit on advertising. We now recognize that to be “the original sin of the Internet” because it misdirects our platforms to serve advertisers and not users.  Algorithms can help augment human intelligence to make us smarter collectively -- instead of making us stupider, as social media now do.  Systems that elucidate nuance, context, and perspective can empower us to draw out and augment the wisdom of crowds (as explained in detail on this blog) to deal more smartly with our deeply intertwingled world.  That could drive a new Age of Enlightenment in which technology augments the marketplace of ideas in the ways that we have always relied on to mediate consent – an emergent mix of top-down guidance and bottom-up emergence that can lead to new, yet natural, forms of digital democracy.

The other relates to failures of our economic marketplace – how we can shift from the short-term. zero-sum logic of extractive mass-market capitalism to more long-term, win-win forms of market cooperation.  That can restore the emergent, distributed, and human logic of traditional markets that Adam Smith saw as socially beneficial -- before modern mass-marketing alienated producers from consumers and lost sight of broader human values.  Our digital economy now enables new ways to shift from fighting over a current pie to cooperating to co-create a larger pie -- and to share it fairly.  That logic can empower a reformation of market capitalism from within that could actually be more profitable, and thus self-motivating.  We can apply the power of computer-mediated marketplaces to let businesses and consumers negotiate at a human level -- about the values they care about, how to co-create that value, and how to share in the benefits.  We have begun to think in terms of customer journeys, but have been trying to fit customers into segments or personas. Instead, we need to design for segments of one that are custom-fit to each customer, to build relationships with each customer on human terms.

These two logics are interrelated: a flawed economic logic for consumer platform services has been built on advertising revenue (“the Internet’s original sin”). That has warped incentives to favor engagement with junk content that sells ads, rather then the value to users of quality content. An improved logic for value will create incentives for our platforms to facilitate a logic for a better marketplace of ideas.

The brief descriptions of these new logics may sound like just more exhortations, but the posts that they link to provide details of operational mechanisms -- and evidence that their elements have proven effective.  These new combinations of elements can quickly become second nature, because they draw on and re-channel natural behaviors that promise to make them highly self-reinforcing.

Many allied visions for better logics of emergence are finding new relevance in this era of crisis.  We have only to join together and rise to the occasion.  We say that “we are all in this together” – we need to open our minds to really think that way, and to work with new logics and “choice architectures” that make that natural.  With better logics, our instinctive behaviors can once again synergize to flow in increasingly enlightened ways.

---
For more about the new logic for the marketplace of ideas (and intertwingularity in general), see this list of selected items on the SmartlyIntertwingled.com blog.

For more about the new logic for the economic marketplace, see this list of selected items on the FairPayZone.com blog.

Friday, January 10, 2020

The Dis-information Choke Point: Dis-tribution (Not Supply or Demand) [Stub]

Demand for Deceit: How the Way We Think Drives Disinformation, is an excellent report from the National Endowment for Democracy (by Samuel Woolley and Katie Joseff, 1/8/20). It highlights the dual importance of both supply and demand side factors in the problem of disinformation (fake news). That crystallizes in my mind an essential gap in this field -- smarter control of distribution. The importance of this third element that mediates between supply and demand was implicit in my comments on algorithms (in section #2 of the prior post).

[This is a stub for a fuller post yet to come. (It is an adaptation of a brief update to my prior post on Regulating the Platforms, but deserves separate treatment.)]

There is little fundamentally new about the supply or the demand for disinformation.  What is fundamentally new is how disinformation is distributed.  That is what we most urgently need to fix. If disinformation falls in a forest… but appears in no one’s feed, does it disinform?

In social media a new form of distribution mediates between supply and demand.  The media platform does filtering that upranks or downranks content, and so governs what users see.  If disinformation is downranked, we will not see it -- even if it is posted and potentially accessible to billions of people.  Filtered distribution is what makes social media not just more information, faster, but an entirely new kind of medium.  Filtering is a new, automated form of moderation and amplification.  That has implications for both the design and the regulation of social media.

[Update: see comments below on Facebook's 2/17/20 White Paper on Regulation.] 

Controlling the choke point

By changing social media filtering algorithms we can dramatically reduce the distribution of disinformation.  It is widely recognized that there is a problem of distribution: current social media promote content that angers and polarizes because that increases engagement and thus ad revenues.  Instead the services could filter for quality and value to users, but they have little incentive to do so.  What little effort they ever have made to do that has been lost in their quest for ad revenue.

Social media marketers speak of "amplification." It is easy to see the supply and demand for disinformation, but marketing professionals know that it is amplification in distribution that makes all the difference. Distribution is the critical choke point for controlling this newly amplified spread of disinformation. (And as Feld points out, the First Amendment does not protect inappropriate uses of loudspeakers.)

While this is a complex area that warrants much study, as the report observes, the arguments cited against the importance of filter bubbles in the box on page 10 are less relevant to social media, where the filters are largely based on the user’s social graph (who promotes items to be fed to them, in the form of posts, likes, comments, and shares), not just active search behavior (what they search for). 

Changing the behavior of demand is clearly desirable, but a very long and costly effort. It is recognized that we cannot stop the supply. But we can control distribution -- changing filtering algorithms could have significant impact rapidly, and would apply across the board, at Internet scale and speed -- if the social media platforms could be motivated to design better algorithms.

How can we do that? A quick summary of key points from my prior posts...

We seem to forget what Google’s original PageRank algorithm had taught us.  Content quality can be inferred algorithmically based on human user behaviors, without intrinsic understanding of the meaning of the content.  Algorithms can be enhanced to be far more nuanced.  The current upranking is based on likes from all of one’s social graph -- all treated as equally valid.  Instead, we can design algorithms that learn to recognize the user behaviors on page 8, to learn which users share responsibly (reading more than headlines and showing discernment for quality) and which are promiscuous (sharing reflexively, with minimal dwell time) or malicious (repeatedly sharing content determined to be disinformation).  Why should those users have more than minimal influence on what other users see?

The spread of disinformation could be dramatically reduced by upranking “votes” on what to share from users with good reputations, and downranking votes from those with poor reputations.  I explain further in A Cognitive Immune System for Social Media -- Developing Systemic Resistance to Fake News and In the War on Fake News, All of Us are Soldiers, Already!  More specifics on designing such algorithms is in The Augmented Wisdom of Crowds: Rate the Raters and Weight the Ratings.  Social media are now reflecting the wisdom of the mob -- instead we need to seek the wisdom of the smart crowd.  That is what society has sought to do for centuries.

Beyond that, better algorithms could combat the social media filter bubble effects by applying measures that apply judo to the active drivers noted on page 8.  Cass Sunstein suggested “surprising validators” in 2012 one way this might be done, and I built on that to explain how that could be applied in social media algorithms:  Filtering for Serendipity -- Extremism, 'Filter Bubbles' and 'Surprising Validators’.

If platforms and regulators focused more on what such distribution algorithms could do, they might take action to make that happen (as addressed in Regulating our Platforms -- A Deeper Vision).

Yes, "the way we think drives disinformation," and social media distribution algorithms drive how we think -- we can drive them for good, not bad!

---
Background noteNiemanLab today pointed to a PNAS paper showing evidence that "... ratings given by our [lay] participants were very strongly correlated with ratings provided by professional fact-checkers. Thus, incorporating the trust ratings of laypeople into social media ranking algorithms may effectively identify low-quality news outlets and could well reduce the amount of misinformation circulating online." The study was based on explicit quality judgments, but using implicit data on quality judgments as I suggest should be similarly correlated, and could apply the imputed judgments of every social media user who interacted with an item with no added user effort.

[Update:] 
Comments on Facebook's 2/17/20 White Paper, Charting a Way Forward on Online Content Regulation

This is an interesting document, with some good discussion, but it seems to provide evidence that leads to the point I make here, but totally misses seeing it. Again this seems to be a case in which "It is difficult to get a man to understand something when his job depends on not understanding it."

The report makes the important point that:
Companies may be able to predict the harmfulness of posts by assessing the likely reach of content (through distribution trends and likely virality), assessing the likelihood that a reported post violates (through review with artificial intelligence), or assessing the likely severity of reported content
So Facebook understands that they can predict "the likely reach of content" -- why not influence it??? It is their distribution process and filtering algorithms that control "the likely reach of content." Why not throttle distribution to reduce the reach in accord with the predicted severity of the violation? Why not gather realtime feedback from the distribution process (including the responses of users) to refine those predictions, so they can course correct the initial predictions and rapidly refine the level of the throttle? That is what I have suggested in many posts, notably In the War on Fake News, All of Us are Soldiers, Already!


See the Selected Items tab for more on this theme.

Monday, December 30, 2019

Regulating our Platforms -- A Deeper Vision (Working Draft)


Redirection and regulation of our Internet platforms is badly needed. There are numerous powerful statements on why, and many smart people working to make that happen.

But it is hard to agree on how, and with what objectives. Most people have little clue of where to start, or why it matters -- and many of those who do are divided about what to do, and whether proposed actions are too small or too large. This is a richly complex problem -- and much of what we read is oversimplified.

I recently immersed myself in some of the best analyses from respected think tanks -- and have some innovative perspectives of my own. This post begins with pointers to some of the best thinking, and then explains what I see as missing. That is largely a question of what are we designing for.

Update 4/26/21: An important strategy for a surgical restructuring (published in Tech Policy Press) — to an open market strategy that shifts control over our feeds to the users they serve — complements the discussion here.

==================================================================
The Ideas in Brief

Our Internet platforms have gone seriously wrong, and fixing that is more complex than most observers seem to realize. The good news is that there are well-conceived proposals for creating an expert regulatory agency that can oversee significant corrections. 

At a complementary level, we should be looking ahead to what these platforms should and could be doing to better serve us. That kind of vision should inform both how we regulate and how we design.
  • One critical need is to change how the algorithms work, so they serve users and society -- to make us smarter and happier, instead of dumber and angrier.
  • Another critical need is to shift the business models so that users, not advertisers become the customers, to better align the incentives of Internet service platforms to serve their users (and actually benefit the advertisers as well).
==================================================================

Broad issues, deep thinking, and vision

Many calls for regulatory action focus on just one or a few of the following diverse categories of abuse. Some of these conflict with one another and are advocated by different parties:
  1. privacy and controls on use of personal data 
  2. moderation of disinformation and false political ads and news and other objectionable content versus freedom of speech and the "marketplace of ideas"
  3. economic sustainability of news media and quality journalism
  4. antitrust, competition, and stifling of innovation
  5. failures of artificial intelligence (AI) and machine learning (ML) -- including hidden bias
The works recommended below stand out for their broad consideration of most or all of these issues and for their informed consideration of the legal background and history of related areas of regulation -- including nuanced First Amendment, antitrust, and media technology issues. They make a strong case that, given the complexity of these issues, compounded by the rapid (and reliably surprising) dynamics of business and technology development, that neither the market nor legislators can provide the necessary understanding and foresight. Instead they unanimously see need for an expert agency with an ongoing charter much like the Federal Trade Commission or the Federal Communications Commission but with the new mix of expertise relevant to the Internet platforms.

Particularly edifying are the analyses of issues and regulation related to the safe harbor provisions of Section 230 of the Communications Decency Act that protects "interactive services" from liability for bad content provided by others. Many have called for repealing those safe harbor protections, seeing that as a license to wantonly distribute harmful content, but these deeper analyses suggests a more nuanced interpretation -- the safe harbor should continue to apply to posting of content, but should not apply to filtered distribution in social media feeds. That is one of the themes I build on with my own suggestions below.

Beyond these excellent works, the gap -- and opportunity -- that I see is to refocus our objectives. We should look beyond just limiting the harms of over-concentration of power as we see them today and in hindsight, but look ahead to where we could be going.
  • Where we should be going is a question for public policy, not tech oligarchs who move fast and break things, and are driven by their private interests. 
  • But to understand that question of where we should be going, we need to understand where we could be going (both good and bad).
We need multidisciplinary efforts to set realistic but visionary objectives that serve all stakeholders as our platforms and technology continue to evolve, and we need to explore alternative scenarios to protect against abuse by some stakeholders against others.

"The Debate Over a New Digital Platform Agency" -- some essential resources

On October 17, I was invited to attend The Debate Over a New Digital Platform Agency: Developing Digital Authority and Expertise, at the The Digital Innovation & Democracy Initiative of the German Marshall Fund of the US in Washington, DC. Three reports that resulted from the work of the panelists were suggested as background reading:
The event generated excellent discussion. I made some comments that were well-received on the further opportunities I saw, and had discussions afterwards with several of the speakers. That led to an introduction to the author of another excellent report on this theme (and a discussion with him):
I highly recommend that anyone with a serious interest in these vital challenges read these reports. The Stigler and Feld reports provide thorough treatments from a US regulatory perspective, and complement one another in important areas. The Furman report is a valuable complement from a UK perspective (and Furman reported that the UK will move ahead to establish such a regulatory body and he has been asked to advise on that). The Kornbluth and Goodman report provides a shorter overview of many of the same issues.

More recently, I found another excellent report that is more focused on the technological and business issues and points toward some of the what I have proposed:
Also worth noting, Ben Thompson's Stratechery newsletter provides excellent insights into the business structure issues of our dominant platforms.

[Update: See the updates at the end for additional valuable resources, and my comments on them.]

My own suggestions on where our platforms could and should be going

The following is an updated rework of comments I sent on 10/20/19 to some of the speakers and attendees at the GMF meeting, followed by some added comments from my later discussion with Harold Feld, and other updates: 

Summary and Expansion of Dick Reisman’s comments on attending GMF 10/17/19 event:

I very much support the proposals for a New Digital Platform Authority (as detailed in the excellent background items cited on the event page) and offer some innovative perspectives.  I welcome dialog and opportunities to participate in and support related efforts. 

(My background is complementary to most of the attendees -- diverse roles in media-tech, as a manager, entrepreneur, inventor, and angel investor.  I became interested in hypermedia and collaborative social decision support systems around 1970, and observed the regulation of The Bell System, IBM, Microsoft, the Internet, and cable TV from within the industry.  As a successful inventor with over 50 software patents that have been widely licensed to serve billions of users, I have proven talent for seeing what technology can do for people.  Extreme disappointment about the harmful misdirection of recent developments in platforms and media has spurred me to continue work on this theme on a pro-bono basis.)  

My general comment is that for tech to serve democracy, we not only need to regulate to limit monopolies and other abuses, but also need to regulate with a vision of what tech should do for us -- to better enable regulation to facilitate that, and to recognize the harms of failing to do so.  If we don’t know what we should expect our systems to do, it is hard to know when or how to fix them.  The harm Facebook does becomes far more clear when we understand what it could do – in what ways it could be “bringing people closer together,” not just that it is actually driving them apart.  That takes a continuing process of thinking about the technical architectures we desire, so competitive innovation can realize and evolve that vision in the face of rapid technology and market developments.

More specifically, I see architectural designs for complex systems as being most effective when built on adaptive feedback control loops that are extensible to enable emergent solutions, as contexts, needs, technologies, and market environments change.  That is applicable to all the strategies I am suggesting (and to technology regulation in general).
  • I cited the Bell System regulation as a case in point that introduced well-architected modularity in the Carterfone Decision (open connections via a universal jack, much like modern API’s), followed by the breakup into local and long-distance and manufacturing, and the later introduction of number portability.  This resonated as reflecting not only the wisdom of regulators, but expert vision of the technical architecture needed, specifically what points of modularity (interoperability) would enable innovation.  (Of course the Bell System emerged as a natural monopoly growing out of an earlier era of competing phone systems that did not interoperate.)  
  • The modular architecture of email is another very relevant case in point (one that did not require regulation). 
  • The original Web and Web 2.0 were built on similar modularity and APIs that facilitated openness, interoperability, and extensibility.
But the platforms have increasingly returned us to proprietary walled gardens that lock in users and lock out competitive innovation.

I noted three areas where my work suggests how to add a more visionary dimension to the excellent work in the cited reports.  One is a fundamental problem of structure, and the other two are problems of values that reinforce one another.  (The last one applies not only to the platforms, but to the fundamental challenge of sustaining news services in a digital world.)  All of these are intended not as definitive point solutions, but as ongoing processes that involve continuing adaptation and feedback, so that the solutions are continuously emergent as technology and competitive developments advance.

1.  System and business structure -- Modular architecture for flexibility and extensibility.  The heart of systems architecture is well-designed modularity, the separation of elements that can interoperate yet be changed in at will -- that seems central to regulation as well – especially to identify and manage exclusionary bottlenecks/gateways.  At a high level, the e-mail example is very relevant to how different “user agents” such as Outlook, Apple mail, and Gmail clients can all interoperate to interconnect all users through “message transfer agents” (through the mesh of mail servers on the Internet).  A similar decoupling should be done for social media and search (for both information and shopping).

Similar modularity could usefully separate such elements as:
  • Filtering algorithms – to be user selectable and adjustable, and to compete in an open market much as third-party financial analytics can plug in to work with market data feeds and user interfaces.
  • Social graphs – to enable different social media user interfaces to share a user’s social graph (much like email user agent / transfer agent).
  • Identity – verified / aliased / anonymous / bots could interoperate with clearly distinct levels of privilege and reputation.
  • Value transfer/extraction systems – this could address data, attention, and user-generated-content and the pricing that relates to that.
  • Analytics/metrics – controlled, transparent monitoring of activity for users and regulators.

2.  User-value objectives -- filtering algorithms controlled by and for users.  This is the true promise of information technology – not artificial intelligence, but the augmentation of human intelligence.
·       User value is complex and nuanced, but Google’s original PageRank algorithm for search results filtering demonstrates how sophisticated algorithms can optimize for user value by augmenting the human wisdom of crowds – the algorithm can infer user intent, and weigh implicit signals of authority and reputation derived from human activity at multiple levels, to find relevance in varying contexts. 
·       In search, the original PageRank signal was inward links to a Web page, taken as expressions of the value judgements of individual human webmasters regarding that page.  That has been enriched to weed out fraudulent “link farms” and other distortions and expanded in many other ways.
·       For the broader challenge of social media, I outline a generalization of the same recursive, multi-level weighting strategy in The Augmented Wisdom of Crowds: Rate the Raters and Weight the Ratings.  The algorithm ranks items (of all kinds) based on implicit and explicit feedback from users (in all available forms), partitioned to reflect communities of interest and subject domains, so that desired items bubble up, and undesired items are downranked.  This can also combat filter bubbles -- to augment serendipity and to identify “surprising validators” that might cut through biased assimilation.
·       That proposed architecture also provides for deeper levels of modularity:  to enable user control of filtering criteria, and flexible use of filtering tools from competing sources -- which users could combine and change at will, depending on the specific task at hand.  That enables continuous adaptation, emergence, and evolution, in an open, competitive market ecosystem of information and tools. (As noted below, the Masnick paper makes a nice case for this.) 
·       Filtering for user and societal value:  The objective is to allow for smart filtering that applies all the feedback signals available to provide what is valued by that the user at that time.  By allowing user selection of filtering parameters and algorithms, the filters can become increasingly well-tuned to each user's value system, as it applies within each community of interest, and each subject domain.
·       First amendment, Section 230, prohibited content issues, and community standards:  When done well, this filtering might largely address those concerns about bad content, greatly reducing the need for the blunt instrument of regulatory controls or censorship, and working in real time, at Internet-speed, with minimal need for manual intervention regarding specific items.  As I understand it, this finesses most of the legal issues:  users could retain the right to post information with very little restriction -- if objectionable content is automatically downranked enough in any filtering process that a service provides (an automated form of moderation) to avoid sending it to users who do not want such content -- or who reside in jurisdictions that do not permit it.  Freedom of speech (posting), not freedom of reach (delivery) to others who have not invited it
-- Thus Section 230 might be applied to posting, just as seemed acceptable when information was pulled from the open Web.
-- But the Section 230 safe harbor protections against liability might not apply to the added service of selective dissemination, when information is pushed through social media (and when ads are targeted into social media). The filtering that determines what users see might apply both user- and government-defined restrictions (as well as restrictions at the level of specific user communities that desire those restrictions). [See 2/4/20 update below on related Section 230 issues.]
(Such methods might evolve to become a broad architectural base for richly nuanced forms of digital democracy.)

[See 1/10/20 Update below on distribution filtering as the choke point for disinformation. It is here that we can reverse the wrong direction of social media that is so destructively making people dumber instead of smarter. This is now expanded slightly as a free standing post, The Dis-information Choke Point: Dis-tribution (Not Supply or Demand)]

3.  Business model value objectives – who does the platform serve?  This is widely observed to be the “original sin” of the Internet, one that prevents the emergence of better solutions in the above two areas.  Without solving this problem, it will be very difficult to solve the other problems.  “It is difficult to get a man to understand something when his job depends on not understanding it”  We call them services, but they do not serve us. Funding of services with the ad model makes those services seem free and affordable, but drives platform services businesses to optimize for engagement (to sell ads), instead of optimizing for the value to users and society.  Users are the product, not the customer, and value (attention) is extracted from the users to serve the platforms and the advertisers.

Also, modern online advertising is totally unlike prior forms of advertising because unprecedented detail in user data and precision targeting enables messaging and behavioral manipulations at an individual level.  That has driven algorithm design and use of the services in catastrophically harmful directions, instead of beneficial ones.

Many have recognized this business model problem, but few see any workable solution. I suggest a novel path forward at two levels:  an incentive ratchet to force the platforms to seek solutions, and some suggested solution mechanisms that suggest how that ratchet could bear fruit in ways that are both profitable and desirable ...in ways that few now imagine.

Ratchet the desired business model shift with a simple dial, based on a simple metric.  A very simple and powerful regulatory strategy could be to impose taxes or mandates that gradually ratchet toward the desired state. This leverages market forces and business innovation in the same way as the very successful model of the CAFE standards for auto fuel efficiency -- it leaves the details of how to meet the standard to each company
·       The ratchet here is to provide compelling incentives for dominant services to ensure that X% of revenue must come from users.  Such compelling taxes or mandates might be restricted to distribution services with ad revenues above some threshold level.  (Any tax or penalty revenue might be applied to ameliorate the harms.)
·       That X% might be permitted to still include advertising revenue if it is quantified as a credit back to the user (a “reverse meter” much as for co-generation of electricity).  Advertising can be valuable and non-intrusive and respectful of data -- explicitly putting a price on the value transfer from the consumer would incentivize the advertising market toward user value. 
·       This incentivizes individual companies to shift their behavior on their own, without need for the kind of new data intermediaries (“infomediaries” or fiduciaries) that others have proposed without success.  It could also create more favorable conditions for such intermediaries to arise.

Digital services business model issues -- for news services as well as platforms.  (Not addressed at the event, but included in some of the reports.)  Many (most prominently Zuckerberg) throw up their hands at finding business models for social media or search that are not ad-funded, primarily because of affordability issues.  The path to success here is uncertain (just as the path to fuel efficient autos is uncertain). But many innovations emerging at the margins offer reasons to believe that better solutions can be found.
·       One central thread is the recognition that the old economics of the invisible hand fails because there is no digital scarcity for the invisible hand to ration.  We need a new way to settle on value and price.
·       The related central thread is the idea of a social contract for digital services, emerging most prominently with regard to journalism (especially investigative and local).  We must pay now, not for what has been created already, but to fund continuing creation for the future. Behavioral economics has shown that people are not homo economicus but homo reciprocans – they want to be fair and do right, when the situation is managed to encourage win-win behaviors. 
·       Pricing for digital services can shift from one-size-fits-all, to mass-customization of pricing that is fair to each user with respect to the value they get, the services they want to sustain, and their ability to pay.  Current all-you-can-eat subscriptions or pay-per-item models track poorly to actual value.  And, unlike imposing secretive price discrimination, this value discrimination can be done cooperatively (or even voluntarily).  Important cases in point are The Guardian’s voluntary payment model, and recurring crowdfunding models like Patreon. Journalism is recognized to be a public good, and that can be an especially strong motivator for sustaining payments.
·       Synergizing with this, and breaking from norms we have become habituated to, the other important impact of digital is the shift toward a Relationship Economy – shifting focus from one-shot zero-sum transactions to ongoing win-win relationships such as subscriptions and membership.  This builds cooperation and provides new leverage for beneficial application of behavioral economic nudges to support this creative social contract, in an invisible handshake.  My own work on FairPay explains this and provides methods for applying it to make these services sustainable by user payments. (See this Overview with links, including journal articles with prominent marketing scholars, brief articles in HBR and Techonomy, and many blog posts, such as one specific to journalism.) 
·       Vouchers.  The Stigler Committee proposal for vouchers might be enhanced by integration with the above methods.  Voucher credits could be integrated with subscription/membership payments to directly subsidize individual payments, and to nudge users to donate above the voucher amounts.
·       Affordability. To see how this deeper focus on value changes our thinking, consider the economics of reverse meter credits for advertising, as suggested for the ratchet strategy above.  As an attendee noted at the event, reverse metering would seem to unfairly favor the rich, since they can better afford to pay to avoid ads.  But the platforms actually earn much more for affluent users (their targeted ad rates are much higher).  If prices map to the value surplus, that will tend to balance things out – if the less affluent want service to be ad-free, it should be less costly for them than for the affluent. And when ads become less intrusive and more relevant, even the affluent may be happy to accept them (how about the ads in Vogue?).

AI as a platform regulatory issue.  Discussion after the session raised the issue of regulating AI.  There is growing concern relating to concentrations of power and other abuses, including concentrations of data, bias in inference and in natural language understanding, and lack of transparency, controls, and explainability. That suggests a similar need for a regulator that can apply specialized technical expertise that overlaps and coordinates with the issues addressed here.  AI is fundamental to the workings of social media, search, and e-commerce platforms, and also has many broader applications for which pro-active regulation may be needed.

Some further reflections

From reviewing Harold Feld's book and discussing it with him:
  • He notes the growing calls for antitrust regulation to consider harms beyond price increases (which ignores the true costs of "free" services) and suggests "cost of exclusion" (COE) as a useful metric of harm to manage for. 
  • I suggest that similar logic argues for more attention to what platforms could and should be doing as a metric of harm. The idea is not to mandate what they should do, but to to avoid blocking it -- and to estimate the cost of not providing valuable services that a more competitive market that is incentivized to serve end-users would provide in some form.  
  • Feld also suggests that is is a proper objective of regulation to support promotion of good content and discourage bad content (just as was done for broadcast media). Further to that objective, my Augmented Wisdom of Crowds methods show how that can become nuanced, dynamic, reflective of user desires, domains of expertise, and communities of interest, and selectively match to the standards of many overlapping communities.  A related post highlights how this can serve as A Cognitive Immune System for Social Media -- Developing Systemic Resistance to Fake News.
  • On Section 230-related issues, an interesting question I have not seen well addressed is how the targeting of advertising interplays with filtering feeds for content of all kinds. 
    -- I advocate that filtering of content feeds should be controlled by and for the end-users of the feeds, and economic incentives should align to that.
    -- Targeting of ads (political or commercial) is currently a countervailing force that directs ads to users in ways that do not align with their wishes (and motivates filtering to inflame rather than enlighten).
    -- Reverse metering of attention and data could provide a basis to negotiate -- in this two-sided market -- over just how targeting meshes with the prioritization and presentation of items in feeds.  (A valuable new resource on the design of multi-sided platforms is The Platform Canvas.)
  • Push vs. pull: also related to managing harmful content, Feld draws useful distinctions of Broadcast/Many-to-Many vs. Common Carrier/One-to-One and Passive Listening vs. Active Participation, I suggest the distinction between Push versus Pull distribution/access is also very important to First Amendment issues:
    -- Pull is on demand requests for specific items, such as by actively searching, or direct access to a Web service.  In a free society there should presumably be very limited restrictions on what content users may pull.
    -- Push is a continuing feed, such as a social media news feed.  This can be a firehose of everything (subject to privacy constraints) or a filtered feed (as typical in current social media).  I think Feld's analysis supports the case that there is no First Amendment right of a speaker to have their speech pushed to others in a filtered feed (no free reach or free targeting, as in my posts below).  Note that filtering items in a feed uses much the same discrimination technology as filtering (ranking) of search results (for example, Google Alerts are “a standing search” that is applied to create a feed of newly posted items that match the standing search).  (I have fundamental patents from 1994, now expired, on a widely used class of push.)
  • Feld addresses the issues of filter bubbles and serendipity and proposes “wobbly algorithms” that introduce more variety (and I found recent support for that in this new CACM article). I have outlined methods for seeking Surprising Validators and serendipity in ways that are more purposeful in going far beyond just random variation.  
  • Regarding the quality of news, he addresses the widely supported idea of “tools for reliable sources,” I suggest that human rating services (like NewsGuard) are far too limited in scope and timeliness, and too open to dispute, to be more than a very partial solution.  The algorithmic methods I propose can include such expert rating services, as just one high-reputation component of a broader weighting of authority and relevance in which everyone with a reputation for sound judgement in a subject domain contributes, with a weighting that is based on their reputation.  The augmented crowd will often be smarter than the experts -- and can work far faster to flag problematic content at Internet scale.
Updating my comments from October, many observers have participated in the recent controversy over how the platforms deal with false political ads. Many fail to understand the critical difference between speech and distribution (nicely put in "Free Speech is Not the Same as Free Reach"*). I explained those issues in Free Speech, Not Free Targeting! (Using Our Own Data to Manipulate Us), and note the emerging agreement (including Feld) that limiting the microtargeting of political ads is a reasonable stopgap, until we can provide a more nuanced solution.

Technical architecture issues

I was very pleased to happen on the Masnick article, Protocols, Not Platforms: A Technological Approach to Free Speech (a couple weeks ago), as the nearest thing to the vision I have been developing that I have yet seen. It is not aimed at regulation, apparently in hopes that the market can correct itself (a hope I have shared, but no longer put much faith in). Our works are both overlapping and complementary – reinforcing and expanding in different ways on very similar visions for user-controlled, open filtering of social media and the marketplace of ideas. I recommend his paper to anyone who wants to understand how this technology can be far more supportive of user value by enabling users to mold their social media to their individual values, and as a foundation for better understanding my more specific proposals.

As background, in developing these ideas for an open market of user-controlled filtering tools, I drew on my experience in financial technology from around 1990. There was a growing open market ecosystem for transaction level financial market data (generated by the stock exchanges and other markets -- ticker feeds and the like), which was then gathered and redistributed to brokers and analysts by redistributors like Dow Jones, Telerate, and Bloomberg. An open market for analytic tools that could analyze this data and provide a rich variety of financial metrics was developing -- one that could interoperate, so that brokers and analysts could apply those analytics, or create their own custom variations (as an early form of mashup). That was an inspiration for work I did in 2002 to design a system for open collaboration on finding and developing innovations, in the days when "open innovation" was an emerging trend. That design provided very rich functions for flexible, mass collaboration that I later adapted to apply to social media (as described on my blog, starting in 2012, when I saw that current systems were not going in the direction I thought they should). 

Personal privacy versus openness, and interoperability

Privacy has emerged as a critical issue in Internet services, and one that is often in conflict with the objectives of openness and interoperability that are essential to the marketplace of services and to the broader marketplace of ideas (and also to making AI/ML as beneficial as possible). Here again there is a need for nuance and expertise to sensibly balance the issues, and there is reason to fear that current privacy legislation initiatives may fail to provide a proper balance. I believe there are more nuanced ways to meet these conflicting objectives, but leave more specific exploration of that for another time.

Moving forward

We have learned that our Web services are far more complex and have far more dangerous impacts on society than we realized. We need to move forward with more deliberation, and need a business and regulatory environment capable of guiding that. We have seen how dangerous it can be to "move fast and break things."

I am working independently on a pro-bono basis on these issues, and welcome opportunities to collaborate with others to move in the directions outlined here. (These ideas draw on two detailed patent filings from 2002 and 2010 that I have placed into the public domain.)

---
[*Update 1/2/20:] Mediating consent by augmenting the wisdom of crowds

Renee DiResta (who wrote the Free Speech is Not the Same as Free Reach post I cited above) recently wrote an excellent article, Mediating Consent, which I commented on today. Her article is an excellent statement of how we are now at a turning point in the evolution of how human society achieves consensus – or breaks down in strife. She says “The future that realizes this promise still remains to be invented.” As outlined above, I believe the core of that future has already been invented — the task is to decide to build out on that core, to validate and adjust it as needed, and to continuously evolve it as society evolves.

[Update 1/10/19:] The disinformation choke point:  distribution (not supply or demand) --

[This is now expanded slightly to be a free-standing post]

An excellent 1/8/20 report from the National Endowment for Democracy, “Demand for Deceit: How the Way We Think Drives Disinformation,” by Samuel Woolley and Katie Joseff, highlights the dual importance of both supply and demand side factors in the problem of disinformation.  That crystallizes in my mind an essential gap in this field -- smarter control of distribution -- that was implicit in my comments on algorithms (section #2 above).

There is little fundamentally new about the supply or the demand for disinformation.  What is fundamentally new is how disinformation is distributed.  That is what we most urgently need to fix. If disinformation falls in a forest… but appears in no one’s feed, does it disinform?

In social media a new form of distribution mediates between supply and demand.  The media platform does filtering that upranks or downranks content, and so governs what users see.  If disinformation is downranked, we will not see it -- even if it is posted and potentially accessible to billions of people.  Filtered distribution is what makes social media not just more information, faster, but an entirely new kind of medium.  Filtering is a new, automated form of moderation and amplification.  That has implications for both the design and the regulation of social media. 

By changing social media filtering algorithms we can dramatically reduce the distribution of disinformation.  It is widely recognized that there is a problem of distribution: current social media promote content that angers and polarizes because that increases engagement and thus ad revenues.  Instead the services could filter for quality and value to users, but they have little incentive to do so.  What little effort they ever have made to do that has been lost in their quest for ad revenue.

Social media marketers speak of "amplification." It is easy to see the supply and demand for disinformation, but marketing professionals know that it is amplification in distribution that makes all the difference. Distribution is the critical choke point for controlling this newly amplified spread of disinformation. (And as Feld points out, the First Amendment does not protect inappropriate uses of loudspeakers.)

While this is a complex area that warrants much study, as the report observes, the arguments cited against the importance of filter bubbles in the box on page 10 are less relevant to social media, where the filters are largely based on the user’s social graph (who promotes items to be fed to them, in the form of posts, likes, comments, and shares), not just active search behavior (what they search for). 

Changing the behavior of demand is clearly desirable, but a very long and costly effort. It is recognized that we cannot stop the supply. But we can control distribution -- changing filtering algorithms could have significant impact rapidly, and would apply across the board, at Internet scale and speed -- if the social media platforms could be motivated to design better algorithms. I explain further in A Cognitive Immune System for Social Media -- Developing Systemic Resistance to Fake News and In the War on Fake News, All of Us are Soldiers, Already! That is what I am advocating in my section #2.

Yes, "the way we think drives disinformation," and social media distribution algorithms drive how we think -- we can drive them for good, not bad!

[Update 2/4/20] Related Section 230 issues.

The discussion above related to posting versus distribution did not clearly address other issues that have driven lobbying against Section 230. These include companies concerned about illegal postings on Airbnb, and about copyright infringement, and other improper content. My initial take on this is that the distinction of posting versus filtered distribution outlined above should also distinguish posting from other forms of selective distribution, such as by search in which a selection or moderation function is present.

For example, Airbnb is a marketplace in which Airbnb may not offer a filtered feed, but offers search services. The essential point is that Airbnb filters searches by selection criteria -- and by its own listing standards. Thus there is an expectation of quality control. As long as Airbnb provides a quality control service, it is moderated, and thus should not have safe harbor under Section 230. If it did not do moderation, then posting on Airbnb should properly have safe harbor protections, but selective (filtered) search functions might not have safe harbor to include illegal postings. Access to such uncontrolled postings might be limited to explicit searches for a specific property identifier (essentially a URL) to retain safe harbor protection.

So here as well, it seems the proper and tractable understanding of the problem is not in the posting, but in the distribution.

[Update 9/9/20] A killer TED Talk and another excellent analysis

Yaël Eisenstat's TED Talk, "How Facebook profits from polarization," is very important, right on target, and well said! If you don’t understand why Facebook and other social media are the gravest threat to society (as they currently operate), this will be the most informative 14 minutes you can spend. (From a former CIA analyst, diplomat…and Facebook staffer.) (9/8/20)

New Digital Realities; New Oversight Solutions from the Harvard Shorenstein Center, by Tom Wheeler, Phil Verveer, and Gene Kimmelman, is another excellent think tank proposal that is right on target. (8/20/20)

[Update 12/14/20] A specific proposal - Stanford Working Group on Platform Scale

An important proposal that gets at the core of the problems in media platforms was published in Foreign AffairsHow to Save Democracy From Technology, by Francis Fukuyama and others. See also the report of the Stanford Working Group. The idea is to let users control their social media feeds with open market interoperable filters. That is something I have proposed, and provided details on how and why to do. 

[Update 2/12/21] Growing support for open market filtering services - Twitter too

More proposals for this have surfaced, including in Senate testimony, plus indications of interest from Twtter. This suggests this may be the best path for action. See this newer post and this update, and stay tuned for more.

[Important Update 4/26/21] 

This important strategy for a surgical restructuring was published in Tech Policy Press. An open market strategy that shifts control over our feeds to the users they serve complements the actions discussed here. This new article summarizes and expands on proposals from notable sources (including Twitter CEO Jack Dorsey) that get at the core of the problems in media platforms. 

---
See the Selected Items tab for more on this theme.

Thursday, December 26, 2019

2020 Vision -- The Restoration of the Customer

The Age of the Customer: You Ain't Seen Nothin' Yet

Nearly a decade has passed since Forrester said we were entering The Age of the Customer. That is apparent and has obvious implications. But as the decade of the 2020's dawns, I call out a deeper vision -- The Restoration of the Customer -- that could bring far more fundamental changes in the coming decade.

There are two surprising turns that may be taken in this decade to restore power to customers -- one that can fundamentally change how we conduct business, and one that can fundamentally change how we collaborate.

Those turns might just begin to undo many of the ills of the industrial revolution and of the computer revolution.  Both turns center on a return to enlightened human values:
  • The customer is not just a persona with a bundle of attributes that a business can learn how to manipulate, but a unique human being that has been bred since pre-history to thrive on a cooperative effort to create value and share it.
  • The user is not just a a source of attention that can be engaged to be sold to advertisers, but a customer to be served what they value -- again, a cooperative effort to create value and share it.
What those paying attention see

Forrester put the basic drivers nicely (emphasis added):
In this era, digitally-savvy customers would change the rules of business, creating extraordinary opportunity for companies that could adapt, and creating existential threat to those that could not. ...It requires leaders to think and act differently – in ways that feel foreign, unfamiliar, and counter-intuitive. And honestly, it is simply hard to do. ...These dynamics will endure as new technologies like artificial intelligence and robotics emerge to challenge core notions of what it means to be a company, what it means to build human capital, and what it means to compete and win.
...And, a deeper vision

Here I point to some little recognized ideas on how re-centering on value can change not only the dynamic of commerce, but also a parallel dynamic of customer value that is equally important.
  • First, the commercial dynamic that Forrester describes is just the foundation for reversing how the "progress" of technology cost us the human dimension in commerce -- a dimension that we had when commerce was just the way villagers did business with one another -- with human beings on both sides of an ongoing relationship. 
  • Second, we humans, as "customers" of Web services, have lost control of our experience of the world.  Our central experience of human interaction has been hijacked by platforms who "engage" us in order to profit from bombarding us with advertising and paid propaganda.
First: Back to the future of commerce

Consumers are increasingly alienated from the companies they do business with. Instead of neighbors or shopkeepers, we deal with soulless institutions that we distrust and feel abused by. That has been, increasingly, the price of productivity and material riches. But now technology has advanced far enough to restore the dimension of human values -- if we applied to do so. That does not require that we abandon the miracle of capitalism, but only that we bring it back to the marketplace of human value. Technology now makes it possible for even large faceless institutions to build human interfaces that behave with human values. That will drive institutions to interact with human in ways that are more truly human.

FairPay is a framework for centering on why and how to do that. The key is to recenter on relationships and the creation and sharing of value in ways that are tailored to each individual. Specifics on how to do that are in my FairPayZone blog, some articles written with prominent marketing scholars, and my 2016 book. Some of the best places to begin to understand this are:
Second: Who does it serve? - a course correction in how we experience the world

Social media and other online content services have changed how we experience the world, including how we interact with other people. Computer-mediation began with great hopes, but now it seems we have built a Frankenstein's monster.  As growing calls for change are beginning to focus on new levels of regulation, it is not enough to regulate against specific harms. Instead we must refocus on what we want to regulate for -- who these "services" serve, and what we want these platforms to facilitate. They were supposed to make us happy and smart -- instead they are making us angry and stupid. But technology can reverse that, if we incentivize that.

We can design new architectures for our interactive media that create value for us.  The key is to recognize that each of us is an individual, and we should be able to individualize our services, mixing and matching offerings to make just the service we want for what we are doing now. The most urgent part of that is to shape our media services to give each of us what we value. The Web stated out seeking to do that, and we can return to that vision. It won't be free, but it can be affordable. And we have seen that "free" is not really affordable (because it is not really free). If we do not change direction, our democracies and our civilization will collapse. Some starting points for seeing how:

(Cross-posted with my other blog, FairPayZone.)