Monday, May 4, 2015

Harnessing the Demons of The Digital Economy

The dynamics of networked commerce combined with the essentially free replication of digital offerings has created devilish problems that our current economics has yet to tame.  Sellers have no clear rationale for setting prices and consumers feel they should not have to pay anything at all.

One way to step back and re-think this is to do a "thought experiment," as has proven valuable in the development of science. Some notable thought experiments involve imagining benevolent "demons" with special powers and/or knowledge: Laplace's demon, with its perfect knowledge of the state of the universe and all its natural laws, and Maxwell's Demon, with its ability to individually sort hot from cold molecules.* Maybe we cannot build such demons, but thinking about them can clarify concepts and possibly point to approximations that can be built, or can suggest directions for looking outside the box.

The demon I propose is one that can power a system of commerce.  Imagine a demon that has perfect ability to read the minds of buyers and sellers to determine individualized "value-in-use" -- the actual value perceived and realized by each buyer, at each stage of using a product or service -- such as songs or articles or e-books, either in a subscription or item-by-item context.
  • This "value demon" knows how each buyer uses the service, how much they like it, what value it provides them, and how that relates to their larger objectives and willingness/ability to pay. It understands the ever-changing attributes of current context, where the value of a given item can depend on when and how it is experienced.
  • Furthermore, this demon can determine the economic value surplus of the offering -- how much value it generates beyond the cost to produce and deliver it.
  • The demon can go even farther, to act as an arbiter of how the economic surplus can be shared fairly between the producer and the consumer. How much of the surplus should go to the consumer, as a value gain over the price paid, and how much of the surplus should go the producer, as a profit over the cost of production and delivery.
This commerce demon could thus serve as the brains of a system that sets prices that are adaptive and personalized -- to set a price for each person, at each time, that is fair to both the producer and the consumer.

Imagine we could build an e-commerce system, with advanced programming and data that worked as an artificial intelligence version of this demon. We could build services like Amazon, iTunes, Netflix, or a newspaper subscription that were priced by the demon. Prices would not be pre-set by the seller, but would be set dynamically by the demon at levels that would be fair and acceptable to both the buyer and seller.

(This takes us in a direction very different from the ideas from the early days of e-commerce of "bots" that would negotiate prices for us. The demon is in some ways analogous to a bot, but instead of negotiating a single transaction, it works at a higher level that centers on value, not just negotiating power.)

With such a demon setting prices, we could reap the cornucopia of goods and services that the infinite replication of digital offerings promise ("information wants to be free") while still providing fair profits to the producers ("information wants to be expensive"). Every consumer who is willing to pay more than the marginal cost of production would be able to buy, while those who get and can pay for significant value would pay appropriately higher prices.

This may sound pointlessly fanciful, but thinking about it can suggest new approaches that are practical.**

One such approach, the FairPay architecture I have been describing in this blog, works very much like an approximation of this demon. Not perfect, but still workable as an emergent process that uses simple procedures and dialogs to approach what this demon knows. Details are in other posts and the sidebar, but some basic points:
  • FairPay shifts our perspective from individual transactions to a series of transactions over time in a relationship.
  • Instead of the invisible hand of supply and demand pushing from outside, it brings an invisible handshake in which the buyer and seller agree to cooperate to find a fair basis to exchange value.  This can inform a new balance of powers, based on "dialogs about value." 
  • The buyer's power is to set prices for a current transaction -- "fair pay what you want" -- with the understanding that he agrees to be fair, and that this is a temporary privilege that the seller will continue only as long as he agrees the prices set by that buyer are usually fair.
  • The seller's power is to decide whether to continue these attractive offers, or not. That gives the buyer full buy-in on all prices, but motivates him to keep up his end of the bargain.
  • Additional data feeds in to the process, including the seller's suggested price to each buyer, the buyer's reasons for pricing higher or lower, and all of the increasingly rich individual details that digital system instrumentation can make available about usage levels, patterns, and contexts, to inform and validate these dialogs.
  • Based on all of that, the seller tracks each buyer's fairness rating, much like a credit rating. Consumers will warm to the idea of this pricing privilege, and will seek to protect their fairness rating just as they do for credit ratings.
The result is an emergent process that seeks to discover the price, just as the demon understands it. The approximation may start out being quite crude, but digital sellers can afford some unprofitable cycles in the early stages of each relationship, if that soon leads toward convergence on fair prices. As experience is gained, this will become a science of Big Data and predictive analytics -- one that works to serve both the buyer and the seller.

So this FairPay process acts as an engine that approximates what the demon knows. It draws out the knowledge of the buyer, encourages truth-telling, nudges that with the views of the seller, and provides a context for the dialogs about value that lead to a fair split between the producer and consumer surplus. Such a process can totally change the game of selling digital stuff, for more profit, and more value to society.

[Update 5/18/15]
To consider the broader implications of this new approach, see this sequel: An Invisible Handshake for The Digital Wealth of Nations.

**[Update 8/3/15] 
I should have added that there is a proven way to approximate my value demon -- but one that has been restricted to high-end, sophisticated industrial markets, and generally ignored in most other markets. As described in a 2014 HBR article, companies like GE are increasingly realizing that set prices are not best for either the supplier or the customer --and for large industrial products or services, it is better to develop custom prices very much along the lines of what the demon knows. These "value-based" pricing or "outcomes-based" models work well for such industrial equipment where a cooperative team of both producer and customer can negotiate not a specific price, but a method of analyzing value as actually achieved by the customer in use, and then basing the price on that after the data is known. Just as the Internet of Things is making that more widely applicable, FairPay points to how a lightweight, heuristic variation on that theme can work for computer-mediated mass consumer markets..

*Expanding on these demons, and the two well-known examples...
  • Laplace's Demon, has been influential in philosophy and physics, as one who has perfect knowledge of both the current state of the entire universe, and all the laws of nature. Thus Laplace's demon can look forward or backward to derive the exact state of the world at any past or future time. This is relevant to questions of free will versus determinism, and to quantum uncertainty.
  • Maxwell's Demon, has been influential in thermodynamics, as a gatekeeper in a box with two chambers separated by a small hole with a door. The demon can control the door to allow high speed molecules to go from left to right only and low speed molecules to go from right to left only, thus making the left side get colder while the right side gets hotter. This would violate the second law of thermodynamics.
(There are reasons why both are infeasible, but thinking about them sheds light on why that is.)

Adam Smith's invisible hand can be thought of as a similar demon that helps balance supply and demand in a market at a given point in time. As we know, Smith's demon actually works fairly well for many markets.

Economics has generally ignored my demon, but it has been lurking in the background. First degree price discrimination was defined by Pigot as applying this kind of information in idealized monopoly situations -- but has been viewed as not realistic for reasons such as arbitrage (those who bought cheaply could resell to others so they did not have to pay the full amount they would be willing to pay).**

I propose that the workings of FairPay enable something much like first degree price discrimination, but instead of all the surplus going to the monopoly, my demon shares it fairly between producer and consumer.  And since resale of digital services can often be made impractical, the arbitrage problem generally does not apply.

[Update 1/1/16]
A nice bit on how Einstein's thought experiments changed the world is Walter Isaacson's "Light Beam Rider" piece in the NY Times (10/30/15).


  1. An even more complex demon/thought experiment might have two further characteristics:
    1) the ability to create the exact knowledge product for a person, based on its perfect knowledge of their state of desire or need
    2) the ability to create pricing and reward structures based on the co-production of service value based on multi-dimensional provider/recipient relationships
    Just a thought (experiment :)

    1. I agree that richer variations on this demon are very interesting.

      1) Yes, I see FairPay as feeding into creation of customized packages, and even customized products, driven by demand/value feedback. This is a direct extension of personalization of products and packaging, and what we might think of as predictive value analytics could be very effective.

      2) Yes, the demon would factor in all relevant dimensions of value. Doing this between producer and consumer is most direct, but it could also extend through the supply/value chain, such as to fairly allocate compensaton between distributors and content creators, in dialog with the consumer. This could be a simple as a Spotify bonus payment from the consumer that is specifically directed to the artist.

  2. I’m not that much of a internet reader to be honest but your blogs really nice, keep it up! I'll go ahead and bookmark your website to come back later. Cheers digital marketing company

  3. It’s very excellent information and more real facts to provided that post.Thank you for sharing this information. 200-125 exam questions answers

  4. Quality equipment is must needed items for a factory. You can try out industrial oven for sale to get an comfortable purchase. They are offering more equipment and services of industrial equipment of ovens, wash station, coatings, etc.

  5. Super knowledgeable concept you unfolded here for us. Modern technology and data flow have made our world at the advanced level it's true and the networked ecommerce and digital economy details you explained in this post definitely very qualitative. I appreciate it so much. BTW want to learn the advanced concepts and get your skills upgraded from the pioneers in Data Science? Alright, here a resource to take a look into-data science classes in nagpur.