clive boulton's net-net

Hadoop without Respect, where’s my Golden Pony?

Haiku:

Respect Networks…

Why aren’t they famous yet?

Only time will tell.

Evolution of the Golden Pony… 

Many of us expert in industrial recommender systems matching Supply and Demand missed the change over from shortage of supply to shortage of demand.

Venture Capital didn’t miss this backing almost anything mining demand inferences. In doing so helping create the open source Web 2.0 Hadoop business architecture to mine social data sources for your personal demand, or rather inferences of your personal intentions, these are often sold to advertisers for ad-targeting.  

Private Equity didn’t miss this shift, taking nearly every public ERP/CRM company operating at scale private. At the core of ERP is MRP (material requirements planning) which business use to match supply/demand. With shortage of supply, MRP behaves as a recommender system for chasing exceptions. With abundant supply, that came with globalization, quality demand becomes the imperative to chase after. 

In hindsight a new classes of companies have come about creating certainty of demand. Greg Gottlesman at Madrona Venture Capital believes that Amazon is in the process of becoming the world’s most valuable company. Amazon creates the best quality demand, a credit card cleared order.

Meanwhile Facebook uses social computing to gather and mine personal data for demand, and sprinkles in adverts to help persuade demand. Others sell your data to ad-tech for targeting. Some even sell your identity details. Just about all make extensive use of Web 2.0 Hadoop for “big data” demand mining.   

What can upset this Golden Pony, shortage of supply?

Shortage of water, oil and other precious raw materials can and will disrupt supply and demand. For example McDonalds and Nike are already investing in smaller suppliers and alternative sources to add diversity and reduce risks in regions of the world with sustainability issues like Indonesia and drought regions.

Nike even went as far as hiring Ward Cunningham to help with prototypes for working in the emerging era of sustainability. Alas, currently over investment in demand systems feels inversely proportional to under investment in supply systems technologies. 

For example the core algorithm for MRP, around since 1970s has been revised for the demand driven era by Carol Patk & Chad Smith in Orlicky’s third ‘DDMRP’ edition — but not web 2.0 social technology updated. Internally we can surmise Amazon has built Hadoop MRP.

The DDMRP authors are superb APICs, Goldratt, TOC, Lean, operations experts not computer scientists — Carlos Guestrin, Ed Chi — versed in machine learning, or social computing technologies.

What can upset this Golden Pony, shortage of respect?

Another possibility, the search for quality demand runs into stricter privacy laws in Europe, UK, Australia. Requiring a shift from away from mining personal data. Emerging pointers supporting this direction are:

  • Ward Cunningham’s (Smallest Federated Datastore) Wiki
  • Brad Fitzpatrick’s (Personal Git) Camlistore
  • Eve Maler’s (User managed identity) UMAWG
  • Adrian Hall’s (user data-flows across devices) deconstructed.io
  • Doc Searl’s (reverse CRM) VRM
  • Drummond Reed’s (VRM cloud services) Respect Network

All these are private by default, put the person or enterprise back to control of their own data for generating quality demand in a granular fashion. Doc’s keynote for the Respect Network brings this shift to trust and respect into commercial perspective. 

Net-net: I need to find a startup crazy enough to explore updating MRP, to match demand and supply with VRM and Respect. Perhaps Jordan Ritter of Napster fame, who has set up Ivy Softworks in Seattle for Data Psychics will incubate joining up the dots?

Till then, inspired by a16z’ Ben Horowitz, listening to the Egosouls-Nirvana: produced by S’pply ‘N’ D’mand: Think I’m going crazy!

Magnet links replaced torrent files on the Pirate Bay, by performing one fundamental architectural change, finding peers who are downloading the same files, but without communicating with a central BitTorrent tracker such as previously operated by Pirate Bay.  
Magnet links primary abstraction identifies a file not by location, but by content (same as CCNx). More precisely, using the content’s cryptographic hash value via DHT. 

It is worth noting that BitTorrent can not ditch the .torrent format entirely and rely solely on Magnet links. The .torrent files hold crucial information that is needed to start the downloading process, and this information has to be available in the swarm.

Eliminating the informational middle man may be the architectural shift we need to interconnect supply chains during critical communication periods such as FDA product recall or inventory available to promise?

Magnet links replaced torrent files on the Pirate Bay, by performing one fundamental architectural change, finding peers who are downloading the same files, but without communicating with a central BitTorrent tracker such as previously operated by Pirate Bay.  

Magnet links primary abstraction identifies a file not by location, but by content (same as CCNx). More precisely, using the content’s cryptographic hash value via DHT. 

It is worth noting that BitTorrent can not ditch the .torrent format entirely and rely solely on Magnet links. The .torrent files hold crucial information that is needed to start the downloading process, and this information has to be available in the swarm.

Eliminating the informational middle man may be the architectural shift we need to interconnect supply chains during critical communication periods such as FDA product recall or inventory available to promise?

The Tipping Point Has Arrived: Market Incentives for Selective Sharing in Web Communications
By Steve Holcombe & Clive Boulton  11 July 2012   Summary: Google+ recognizes the value of selective sharing in providing information producers with controls for overcoming both over-sharing and fear of sharing. The Google Affiliate Network is providing sustainable, market-driven incentives for supporting selective sharing. The dynamic blending of Google+ and the Google Affiliate Network could over time bring within reach a holy grail in web communications – the cracking of the data silos of enterprise class supply chains for increased sharing with consumers of what to-date has been “off limits” proprietary product information. But, first, a careful look should be made at providing selective sharing which incorporates fixed data elements at a single location with authorizations.

The Tipping Point Has Arrived: Market Incentives for Selective Sharing in Web Communications

By Steve Holcombe & Clive Boulton
11 July 2012 


Summary: Google+ recognizes the value of selective sharing in providing information producers with controls for overcoming both over-sharing and fear of sharing. The Google Affiliate Network is providing sustainable, market-driven incentives for supporting selective sharing. The dynamic blending of Google+ and the Google Affiliate Network could over time bring within reach a holy grail in web communications – the cracking of the data silos of enterprise class supply chains for increased sharing with consumers of what to-date has been “off limits” proprietary product information. But, first, a careful look should be made at providing selective sharing which incorporates fixed data elements at a single location with authorizations.

Dr Rufus Pollock on Nike opening up supply chain data (hiring open data scientist last yr @WardCunnigham ). “Nike is opening up their data because they need suppliers to open up theirs”.

The key to the company’s success is the use of technology to streamline the production chain. Ms. Abbas explains, “M-Farm has a contract with a local exporter, who buys the produce directly from the farmers” using their mobile devices. This gives farmers access to a reliable and guaranteed market that enjoys stable year-round prices while eliminating middlemen and lowering transaction costs.

According to Ms. Abbas, this system sets M-Farm apart from other organizations. Nevertheless, gaining the trust of the farmers was a difficult process. Many farmers were jaded by initiatives that had left them out to dry when they ran out of funds. “There’s an existing body [of projects] supporting the farmers today, and the next day they are no longer there. This makes farmers skeptical and lose trust” in projects similar to M-Farm.” So, the founders’ strategy is to “spend a lot of time and resources to make the farmers understand we are different.”

Two recent college grads plant a single acre of Corn and follow it from seed to diner plate

Two recent college grads plant a single acre of Corn and follow it from seed to diner plate