
Music Streaming Patterns in India, US and Singapore

Devendra Desale reports for KDnuggets on Saavn presentation at Strata Singapore:
Rishi Malhotra, Cofounder and CEO, Saavn shared how a music streaming company who has a large portion of mobile users (95%), has used this rich data to improve their services. Data has to be part of company “Eat data for breakfast” is of the motto of the company. Their datasets act as proxy for billion users, track how user access the service and find patterns. He emphasized on the data ripple reflect, and how corporates should consider collaborating and developing cross-industry strategies based on data.
Teaching Kids to Code (Infographic)
Brought to you by DataScience@SMU, a masters in data science
Using Deep Learning in Medicine (Video)
https://youtu.be/3WBpJKDv1U8
Jeremy Howard, founder and CEO of Enlitic, argues that the release of Google’s TensorFlow will have an impact similar to the release of the C programming language and that Deep Learning will have an impact similar to that of the advent of the “Internet” (I’m sure he knows it’s actually the World Wide Web) in the 1990s.
7 Predictions for 2016 from IDC
Issuing IDC’s top 10 predictions for 2016, chief analyst Frank Gens advised enterprises to transform or die, noting that the overarching theme for 2016 is “digital transformation scales up.” Scale is the “critical ingredient in the unfolding battle for digital success,” said Gens, warning that while for some enterprises, “scale wins,” for others “scale kills.”
Digital transformation (DX) will drive “everything that matters in IT” over the next several years. Succeeding in what IDC calls the DX economy means using technologies such as mobile, cloud, big data analytics, IoT, AI and robotics to “create competitive advantage through new offerings, new business models, and new customer, supplier, and distributor relationships.”
Here’s my edited version of IDC’s 2016 predictions, based on the IT Industry, Digital Transformation, and CIO Agenda webcasts.
Digital transformation will reach massive scale
Over the next three to five years enterprises will commit to digital transformation on a massive scale, leading to the emergence of the DX Economy. Acknowledging the seemingly paradoxical nature of the term “customer intimacy at scale,” IDC predicts it will be the biggest, most complex enterprise-wide DX initiative that organizations will have to face, requiring a fundamental cultural and operational transformation. In addition, enterprises will pursue a rapid expansion of their customer base and they will have to deliver dramatically more personalized customer service.
As the DX economy is depressing pricing, scaling customers is a must, says IDC, prompting enterprises to “serve the global 50 million.” Scaling up your customer population and how you interact with them will be mandatory for increasing revenue and sustaining market share.
“IT spending will be driven by doing entirely new things rather than using new technologies to do old things,” said Gens on the IDC webcast.
Every company will be a software company
The DX economy – operating at scale – will be “driven primarily by code.” Enterprises’ ability to grow and compete will increasingly depend on their digital “innovation capacity”—the size and talent of their software development teams. In the DX economy, “code plus data equal innovation.”
This will make “software developer” the sexiest job of the 21st century. Enterprises will compete to hire for these essential jobs and software developers will be key for the creation of the new, revenue-generating, productivity-enhancing applications, tapping into the potential of new technologies (e.g., IoT) and embedding data analytics.
The roles and activities of CxOs will be re-defined
In many companies, CEOs will be directly involved in digital transformation initiatives, ensuring it is a primary component of the company’s overall strategy. CEOs will actively participate in the recruitment of the best software developers and “must understand that being a technology company takes more than bold statements.” Line-of-Business (LOB) executives will manage software developers and will have to become adept at technology governance.
CIOs will have to adapt to an increasingly market-facing role for them and their organizations and also work on developing and maintaining internal relationships, partnering with business executives and reaching out to the software developers working in the business units.
A new executive position, that of the Chief Digital Officer (CDO), is needed, but it could be filled by business-savvy CIOs. The CIO must have a plan for transforming IT from being the custodian of the infrastructure to more of a service provider. While digital transformation marginalizes IT, it (and the CIO) could be “a true change agent” and a “transformation engine.”
The Cloud will be the new IT
“Cloud First” will become the new mantra for enterprise IT as the “cloud is the new core of enterprise IT,” said IDC’s Gens. The most “functionally-rich IT offerings” will be found in the cloud.
Enterprises with advanced DX initiatives will create and/or partner with industry cloud platforms to scale up their digital supply and distribution networks. While there will be major consolidation in the public cloud market (down to six “mega-platforms”), there will be rapid proliferation of industry cloud platforms. With industry cloud platforms, GE and others are building epicenters of growth, creating innovation communities, and re-inventing their industries and how to source and distribute innovation at massive scale.
Big data becomes bigger and richer (and enriching)
Success in the DX economy will depend on the ability to build robust “data pipelines” that flow both in and out of the enterprise. Data analytics (Cognitive Services) will be embedded in new apps, and the top new Investment areas over the next couple of years will be Contextual Understanding and Automated Next Best Action capabilities. Companies will look to monetize their own data, participating in a “data race” to fuel innovation.
Mastering “cognitive” is a must, says IDC, recommending making machine learning a top priority for 2016—“lots of startups in your industry are already using it to disrupt you.”
The IoT will be a key driver of the DX Economy
IoT devices and solutions have the potential to redefine competitive advantage in virtually every industry. IDC predicts that the most active IoT development will cluster around the manufacturing, transportation, retail, and healthcare industries.
The coming IT Industry shakeout
A significant portion of today’s IT suppliers will be acquired, merged, downsized, or significantly repositioned. In this environment, enterprises will have to constantly monitor and assess the solutions offered by their suppliers and partners and be prepared to realign these relationships as needed. Possibly more than in any other economic sector, the players in the IT industry need to transform or die.
In the face of the increased volatility of the IT industry, IDC advises IT buyers to increase investments in vendor/partner management, pursue open and multi-source strategies, and find ways to share risks and rewards.
———————-
As Gens reminded listeners to this year’s webcast, IDC predicted last year that “by 2018, one third of the top 20 in every industry will be disrupted by digitally transformed competitors.” Gens advised then companies in all industries to “Amazon” themselves, but also predicted that the best job of “Amazoning” will be done by Amazon itself.
Indeed, Amazon and other Web-born companies (also called “digital natives”) such as Google and Facebook, are not “digitally transformed,” they define “digital.” This begs the question: is the “DX Economy” going to be dominated by relatively young companies that have been in the business of digitally transforming everything in their path and regarding “IT” as their business, not as a “function” or a ”service”?
IDC predicts digital transformation to be a key strategy for 67% of the Global 2000 by 2018 and that by 2017, over 50% of the IT budget will be spent on new technologies. This implies an unprecedented rapid transformation in the current allocation of IT dollars, according to CIO surveys. As just one example, Deloitte has found out in a recent survey of more than 1,200 senior technology executives working for mostly large companies worldwide that only 15% of CIOs are investing in emerging technologies and only 16% of the IT budget is spent on “business innovation.” That’s a stark contrast to Gens’ declaration that over the next few years “IT spending will be driven by doing entirely new things.”
There is also almost no reference in IDC’s predictions to possible challenges and roadblocks to the progression to a full-blown DX Economy. The only factors that were mentioned that could possibly slow down the predicted rapid transformation (and they were not mentioned as speed bumps) were a privacy backlash and security (and the latter only in the context of IoT).
But that’s the nature of the business. Soothsayers are not expected to equivocate, to talk about possible scenarios, or why their forecasts could be wrong or unrealistic. They are expected to provide quantitative certainties and warn us that if we don’t follow the one and only path to the future, we will be “disrupted.” Still, I believe that what they tell us is very valuable as a great summary of contemporary conventional wisdom and what has happened over the previous few years which could serve as a solid foundation for discussion and debate.
IDC sees the DX Economy in its crystal ball, Gartner conjures the Programmable Economy (“a massive technology-enabled transformation of traditional concepts of value exchange, empowering individuals and smart machines to both define value and determine how it is exchanged”).
Industry analyst firms such as IDC and Gartner are expected to tell us what the future will look like and they provide the goods. Inventors such as Tim Berners-Lee and ambitious entrepreneurs such as the people that founded Amazon, Google, and Facebook, create the future. And most of the time, it is an unexpected future that no one has predicted.
Originally published on Forbes.com
28 Numbers from IDC about IT Futures

By 2020, almost 50% of IT budgets will be tied into DX (digital transformation) initiatives.
By 2018, Line of Business (LOB) executives will control 45%+ of all IT spending worldwide, over 60% in the U.S.
By 2017, over 50% of IT spending will be for new technologies (mobile, cloud, big data, etc.).
By 2018, 35% of IT resources will be spent to support the creation of new digital revenue streams.
By 2017, 40% of services managed by IT will be business services oriented to augmented experience and smart products.
By 2018, at least 50% of IT spending will be cloud based.
By 2018, 65% of all enterprise IT assets will be housed offsite and 33% of IT staff will be employed by third-party managed service providers.
By 2020, more than 30% of current IT vendors will not exist as we know them today.
By 2018, 75-80% of public cloud services will be consolidated to 6 platform vendors, including Amazon, Google, IBM, Microsoft, and Salesforce.
By 2018, over 50% of enterprises will create and/or partner with Industry Cloud Platforms (ICPs) to distribute their own innovations and source others‘.
By 2018, over 80% of advanced DX will plug into these communities and the number of ICPs will grow 4-5X from 100 to close to 500.
By 2020, the percentage of enterprises creating advanced DX initiatives will more than double from today’s 22% to almost 50%.
By 2018, 67% of the CEOs of Global 2000 enterprises will have DX at the center of their corporate strategy.
By 2017, 60% of enterprises with a DX strategy will deem it too critical for any one functional area and create an independent corporate executive to oversee the implementation.
By 2017, 80% of global CIOs will initiate a data transformation and governance framework to turn information into a competitive business differentiator.
By 2018, 75% of the G2000 will deploy “Digital Twins” of their products/services, supply network, sales channels, and operations.
By 2020, 60% of the G2000 will double their productivity by digitally transforming any processes from human-based to software-based delivery.
By 2018, 80% of B2C and 60% of B2B enterprises will overhaul their “Digital Front Door” to support 1,000X to 10,000X more customers and customer touch points.
By 2018, enterprises with DX initiatives will double the size of their software development teams.
By 2018, 67% of developers will be focused on business innovation, up from less than 33% today.
By 2018, enterprises with DX strategies will expand external data sources by at least 3X to 5X and delivery of data to the market by 100X or more.
By 2018, 67% of Software-as-a-Service (SaaS) vendors will offer data as part of their service.
By 2018, over 50% of developer teams will embed “Cognitive Services” (i.e., data analytics) in their apps, up from 1% today, providing U.S. enterprises $60+ billion in annual savings by 2020.
By 2018, at Least 20% of all workers will use automated assistance technologies to make decisions and get work done.
By 2018, there will be 22 Billion IoT devices installed, driving the development of over 200,000 new IoT apps and services.
By 2018, IoT spending will grow 1.5X.
By 2018, 66% of networks will have an IoT security breach.
By 2020, there will be 5X increase in the capability of robots in manufacturing.
Source: IDC’s IT Industry, Digital Transformation, and CIO Agenda webcasts.
Originally published on Forbes.com
How to evaluate a data scientist

What’s commonly expected from a data scientist is a combination of subject matter expertise, mathematics, and computer science. This is a tall order and it makes sense that there would be a shortage of people who fit the description. The more knowledge you have, the better, however, I’ve found that the skillset you need to be effective, in practice, tends to be more specific and much more attainable. This approach changes both what you look for from data science and what you look for in a data scientist.
A background in computer science helps with understanding software engineering, but writing working data products requires specific techniques for writing solid data science code. Subject matter expertise is needed to pose interesting questions and interpret results, but this is often done in collaboration between the data scientist and subject matter experts (SMEs). In practice, it is much more important for data scientists to be skilled at engaging SMEs in agile experimentation. A background in mathematics and statistics is necessary to understand the details of most machine learning algorithms, but to be effective at applying those algorithms requires a more specific understanding of how to evaluate hypotheses…
We tend to judge data scientists by how much they’ve stored in their heads. We look for detailed knowledge of machine learning algorithms, a history of experiences in a particular domain, and an all-around understanding of computers. I believe it’s better, however, to judge the skill of a data scientist based on their track record of shepherding ideas through funnels of evidence and arriving at insights that are useful in the real world.
65% growth in mobile data traffic over last 12 months driven by video





- Video dominates data traffic: Global mobile data traffic is forecast to grow ten-fold by 2021, and video is forecast to account for 70 percent of total mobile traffic in the same year. In many networks today, YouTube accounts for up to 70 percent of all video traffic, while Netflix’s share of video traffic can reach as high as 20 percent in markets where it is available.
- Mainland China overtakes the US as world’s largest LTE market: By the end of 2015, Mainland China will have 350 million LTE subscriptions – nearly 35 percent of the world’s total LTE subscriptions. The market is predicted to have 1.2 billion LTE subscriptions by 2021.
- Africa becomes an increasingly connected continent: Five years ago (2010) there were 500 million mobile subscriptions across Africa; by the end of 2015 this number will double to 1 billion. Increased connectivity improves the prospect of financial inclusion for the 70 percent unbanked through mobile money services starting to take form across Africa.
Only 16% of IT budgets are allocated to investments in innovation and growth
While 45% of CIOs identify “innovation” and 44% point to “growth” as their organizations’ most important priorities, only 15% are investing in emerging technologies . Only 16% of IT budgets are allocated to investments in innovation and growth, with the balance spent on running day-to-day operations and incremental change.
This gap between aspirations and reality is one of the key findings of the just-published Deloitte 2015 Global CIO Survey. The study is based on interviews with 1,271 CIOs from 43 countries, with the majority of the participants working for organizations with revenues of more than $1 billion.

“Every company today is a technology company,” says Khalid Kark, U.S. CIO research director at Deloitte Services, and the business priorities reported by CIOs are the same regardless of industry, geography, and company size. All companies are embracing digital technologies and see them as critical for their future.
The study uncovered, however, differences in how CIOs see themselves, what is expected of them, and how they would like their career to progress. In contrast to other surveys that focus on spending priorities, the Deloitte study is mostly about different roles CIOs play today in their organizations and the impact they would like to make in the coming years.
The CIOs were asked detailed questions along the four dimensions that frame the impact of a CIO—the organization’s priorities, competencies and strengths of the CIO, building relationships internally and externally, and technology investments. Here are some of the more interesting results of the survey:
Only 9% of CIOs say they have all the skills they need to succeed
CIOs have to be ambidextrous, mixing business strategy skills with operations management: Out of 12 leadership capabilities, CIOs selected six as the most important for success in their role—influence with internal stakeholders, communication skills, understanding strategic business priorities, talent management, technology vision and leadership, and the ability to lead complex, fast-changing environments.
CIOs think they need especially to improve their leadership skills
The CIOs were asked to select the top five competencies that a successful technology leader need and to identify their own top five strengths. The skills with the largest gaps were the ability to influence internal stakeholders, talent management, and technology vision and leadership. Conversely, CIOs think they are strong in operations and execution, ability to run large-scale projects, and leverage with external partners but do not consider these as differentiating skills for successful technology leaders.

Strong relationships with other executives do not necessarily mean strong influence on the business
48% of CIOs report “strong relationships” with their CEO and interaction at least once a week, and an additional 17% report daily interactions. But only 42% of the CIOs were co-leaders in business strategy decisions and only 19% in M&A activities.
No common definition for “digital”
Digital (71% of respondents), along with analytics and business intelligence (77%) are expected to have the most impact on the business over the next two years. But when asked further to describe their digital initiatives, the answers ranged from analyzing customer data and developing new products and services to improving customer experience and enabling the workforce to better collaborate or be more productive. The lack of common definition, says the study’s report, “is often confusing for business leaders and can lead to misunderstandings and conflicting goals.”

Analyzing the answers to the questions about CIO performance and impact, Deloitte uncovered three distinct CIO “archetypes,” describing how CIOs are delivering value today—and how they are preparing for what comes next:
Trusted Operators keep the lights on. They focus on cost, operational efficiency, and performance reliability. They also provide enabling technologies, support business transformation efforts, and align to business strategy. Their core competency is to drive down costs by rationalizing, renewing, and consolidating technology, and they focus on internal customers. 42% of the CIOs surveyed fall into this category.
Change Instigators drive transformation. They take the lead on technology-enabled business transformation and change initiatives. They look outside the organization for partners and are focused on the end-customer of the business. They are 21% more likely than other CIOs to call technology vision a strength. 22% of the CIOs surveyed fall into this category.
Business Co-Creators perform a balancing act, handling both business strategy and efficient operations. They operate across multiple dimensions of creating and delivering value, and were 24% more likely to cite ability to influence internal stakeholders as a top-five strength. They invest in emerging technologies as a way to drive new sources of revenue or to transform the way they deliver value to customers. 36% of the CIOs surveyed fall into this category.
“Change Instigators try to bring enhancements to existing business models, while Business Co-Creators often have the mandate to find new business opportunities and define new business models,” says Deloitte’s Kark. It’s the Business Co-Creators that tend to invest more in emerging technologies and co-create new business models with internal business partners.
Kark thinks about the three archetypes as a self-diagnostic tool for CIOs to examine where they are and how they fit the needs of their organization. It can also help identify shifting business needs and with them, an emerging shift in how the business defines the CIO role.
Many of the CIOs surveyed indeed see a transformation in their roles in the near future or would like to see such a transformation. The proportion of Change Instigators is expected to remain the same at 22%. A big shift will occur, however with the other two types of roles: The proportion of Trusted Operators will go down from 42% to 12% and the proportion of Business Co-Creators will expand from 36% to 66%.
Almost a third of the CIOs surveyed aspire to shift their role into a business leadership position, working with other business executives to define and pursue new business opportunities, while maintaining their reputation as top-notch IT operators. But, says Kark, “if they don’t build the right skill set, if they don’t build the relationships, it’s going to be hard for them to make that transition. CIOs have to drive technology into the core of the business and if they are not able to do it, someone else will.”
The good news is that for those making the transition, career opportunities abound. “Over the next 3 years, more than half of all businesses will need CIOs of the Business Co-Creators type,” predicts Kark.
Originally published on Forbes.com

