The NIH (Not Invented Here) Barrier
This page exists because the vast majority of engineering people have spent their lives in large companies and have never experienced what it is like to be an individual or tiny company trying to sell ideas, Intellectual Property (IP) or designs to large technology companies and they really have no idea what it is like.
Although this web page desribes my experience in trying to crack the NIH barrier, I have no doubt that every individual or tiny company will have essentially the same experience.
We all have a strong tendency to believe that if someone comes up with a new and useful product idea, it will be immediately accepted, companies will be eager to develop and manufacture it, buyers will rush to buy it, and it will be highly successful, but, in my opinion, that belief usually is not true.
People are creatures of habit, and they do not necessarily want new things. Many people prefer old, proven things to new, unproven things. For example, someone may invent a new and improved mousetrap which may actually be much better than existing mousetraps, but many people will object saying, "what's wrong with the mousetrap I'm using? I've been using that type of mousetrap for 40 years, it works well, it’s reliable, I know how to use it, I'm used to it, and I'm not going to change to some other type of mousetrap." There’s nothing wrong with that way of thinking, but that type of thinking makes it extraordinarily difficult to get new ideas listened to, fairly evaluated and implemented.
New ideas are disruptive and new radical ideas can be immensely disruptive. People, companies, industries, and management hierarchies do not like disruptions and will oppose anything that is extraordinarily disruptive. The strength of the opposition will be in proportion to how disruptive the new thing is. The more disruptive the thing is, the more opposition there will be to it.
I used to think that if someone came up with a really great idea that would greatly benefit society, everyone would be excited about it and it would easily be accepted because it was such a great idea and would benefit everyone. I have come to believe now, based on actual real-world experience over a lifetime, that the greater the idea is, the more likely it will be totally rejected and not accepted at all. In fact, you could not give it away. Nobody would want it because it would be too disruptive and would probably cause a great shift in our society away from some established systems and institutions and the powers that control those systems and institutions would use their power to make sure the new disruptive thing was not implemented. You see an example of this type of a situation with Nikola Tesla’s proposed AC power distribution system versus Thomas Edison’s established DC power distribution system. (Edison did everything within his power to prevent AC power systems from being developed including publicly electrocuting animals using AC power to try to make the public afraid of AC power. By the way, the AC electrical generation and distrubiton system envisiond by Nikola Tesla is the one all of us are using today.)
If, for example, someone invented a free electricity machine, what would that mean if it was accepted and implemented? The whole electrical power generation and distribution system and all of the plants, equipment and management hierarchies would become obsolete, many jobs would be lost and it would be extraordinarily disruptive to thousands and thousands of people. Obviously, people need jobs and want incomes and many people would strongly object to and oppose such a change.
It probably will be very difficult for anyone to believe the statements made on this web page unless they have spent their lifetimes, as I have, in promoting new and innovative ideas and observing how people really react to those ideas - not how one would hope, think or wish they would react, but how they actually do react. They react in ways that most people would never expect.
For more than 30 years not one single person has objected to developing a 2D-RS HDD because any of the statements or claims made by ECC Tek (see 2D-RS HDDs) are untrue, incorrect, inaccurate or misleading. To the best of ECC Tek’s knowledge, all of ECC Tek’s claims are true, accurate, correct and not misleading. It appears that whether the statements and claims made by ECC Tek are true or not does not matter because ECC Tek has no political power when it comes to deciding whether or not 2D-RS HDDs are developed into commercial products. The only political power ECC Tek has is the power of the words it has published on the web and in documents.
One of the most difficult things to understand is that, since there are many indications the 2D-RS HDD idea makes sense, could be highly successful and could potentially be a revolutionary product, why is it that every HDD company in the world has repeatedly refused to seriously consider developing a 2D-RS HDD product for around 30 years (more than a quarter of a century) and today continue to reject the idea? I first had the idea of using an error-correcting code to create faul-tolerant storage systems in 1982 (35 years ago) and presented the ideas to the CEO and CTO of what is now Seagate in 1985 (32 years ago).
2D-RS HDDs would not be difficult for an existing large disk drive company such as Seagate, WD or Toshiba to develop. Most-likely, the questions that are most difficult to answer regarding 2D-RS HDDs will never be answered until some disk drive company develops one.
Some people say, “If the 2D-RS HDD idea is so great, why hasn’t some company developed one?” Those people do not seem to understand that many things that, in the end, proved to be very valuable, good and highly successful were initially repeatedly rejected over long periods of time. Norman Vincent Peale had his first book “The Power of Positive Thinking” rejected so many times that he finally gave up and threw the manuscript in the waste basket. His wife retrieved it, and it was finally published and became wildly successful. Most publishers repeatedly refused to consider publishing J.K. Rowling’s “Harry Potter” books. C.S. Lewis did not publish “The Chronicles of Narnia” for years because it was rejected by his best friend J.R.R. Tolkien. Robert M. Pirsig's book “Zen and the Art of Motorcycle Maintenance” sold 5 million copies worldwide. It was originally rejected by 121 publishers, more than any other bestselling book, according to the Guinness Book of Records. (See this site.) Philo Farnsworth never ever got the credit he deserved for his invention and died depressed. Almost nobody even knows Farnsworth’s name even though he invented one of the most important inventions ever - Television. RCA claimed credit for television. It took years for Nikola Tesla to get the first prototype made of his induction motor. Tesla died in poverty. Many people consider the copy machine the most important invention of the 20th century. For 6 years Chester Carlson tried to interest a company in his invention. Companies such as IBM, RCA, and GE turned him away. It wasn't until 1959 – 21 years after the original invention – that Carlson's idea turned into reality. It took Carlson several more years before a practical version was developed. Consider the story of Louis Braille. The world we live in is not ideal. There are tens if not hundreds of other similar stories of ideas being repeatedly rejected over long periods of time followed by tremendous success.
My understanding from reading other articles is that Dr. Raymond Damadian's partner committed suicide because of the depression, frustration, sadness and despair caused by having their MRI invention being repeatedly rejected over a long period of time. At one point in this video, you can sense that Damadian has a difficult time not breaking down emotionally in talking about the suffering they had to endure.
Rejection of new things is natural and normal. Whenever a new organ is transplanted into a body, that body naturally rejects it and extraordinary efforts must be taken to fight back against the rejection of the new organ.
Engineering employees in existing HDD companies can repeatedly reject the 2D-RS HDD idea and then they can say, “If the 2D-RS HDD idea is so great, why hasn’t some company developed one?” That’s a good strategy to prevent 2D-RS HDDs from ever getting developed.
I was probably one of the most innovative, creative, dedicated and hard-working design engineers at Control Data from 1969 to 1985 and was the instigator of many innovative yet practical and down-to-earth projects and products, and I know exactly how other similar design engineers think. They think there is nothing anyone else can do that they could not do as well or better themselves. They believe in themselves and their own abilities which is a necessary quality for being a good design engineer. Because of that, they would never ever accept the idea of licensing a design from outside their own organization. I was irate when the CDC Disk Drive Division decided to license mechanical designs for a small disk drive from an outside, independent mechanical design engineer and thin film head designs from Memorex. I said, “Why would any rational manager decide to license designs from outside when we have hundreds of our own creative and competent designers right here!” I was outraged by it and let everyone around me know how I felt. However, in looking back, the decision to license designs was the right decision for the Control Data Disk Division. If they had not done it, they probably would not have remained competitive. I know with 100% certainty that good designers would never agree to license designs from some outside party, and they will always come up with reasons not to do so. I was 100% successful in coming up with reasons why every idea I was asked to evaluate that came from outside Control Data was rejected.
It doesn’t take a very creative design engineer to come up with numerous reasons why 2D-RS designs should not be licensed from ECC Tek such as the following:
If you are an engineer in an HDD company you can easily come up with more reasons why 2D-RS designs should not be licensed to add to the above list. It only takes one of them to prevent 2D-RS HDDs from being developed in your company.
Any one of the above “reasons” can be used to reject the 2D-RS ideas because executive managers, CEOs, etc. trust the judgement of technology managers. If a technology manager thinks the submitter of an idea is incompetent or a troublemaker, for example, the senior management will trust his/her judgement regarding that matter. Several CEOs of technology companies have e-mailed me saying “I don’t know anything about ECC”. They have no choice other than to trust the judgement of technology people under them.
As long as employees in HDD companies who have repeatedly rejected the 2D-RS HDD ideas for the last quarter century continue to receive pay raises and promotions (in other words, are rewarded for that behavior), the 2D-RS HDD ideas will never get implemented unless some executive in some HDD company who has wisdom, courage and insight orders that they be developed. That executive also has to have enough wisdom, understanding, insight and courage to stop their company’s lawyers from making decisions for the company because all lawyers are rigorously trained to eliminate risk and there will always be risk in developing any new idea and therefore all lawyers will advise against it. With the possible exception of Steve Jobs at Apple, as far as I know, all CEOs of large technology companies rely on their technical people to make technical decisions and will not get involved in making those kinds of decisions so you can pretty much rule out the idea of any CEO intervening. When CEOs believe they have a secure position and are receiving millions of dollars in compensation every year, what incentive do they have to take a risk and stick their necks out? None.
Even if a CEO ordered that some new idea be developed without the approval of the technical people under him/her, that development effort most-likely would not succeed because almost every person resents being forced to do something against their will, and most-likely will do everything within their power to sabotage the development effort to make sure it ends in failure. That’s human nature.
To the best of my knowledge, no storage company has had any justifiable reason for rejecting the 2D-RS ideas for more than 32 years. They don't have to have a reason. Up to now, they have had all the political power. That's just the way it is.
One reason HDD companies have not accepted the 2D-RS HDD ideas for the last quarter century is because, up to now, they have been able to ignore the idea without any negative consequences. As soon as solid-state mass storage companies start to become profitable and HDD revenues start declining, then there will be a reason for HDD companies to do something other than what they have been doing for the last 50 years. Even then, HDD companies may not be able to change. Carriage manufacturers could not make the transition to automobiles and vacuum tube manufacturers could not make the transition to transistors and went out of business. Many intelligent, capable, technical and analytical people believed and would have argued that the Titanic was unsinkable up until the time it hit the iceberg that sunk it.
The real threat to HDDs most-likely will come from solid-state memory technologies such as Memristors, RaceTrack, STT-MRAM, PCM and other solid-state technologies that are currently being developed or some combination of them rather than from NAND Flash. NAND Flash has given everyone a small sample taste of what’s to come.