Risk Management
  • Home
  • Features
  • Columns
    • ForeFront
    • Last Word
    • Findings
    • Q&A
    • Time Line
    • Risk Atlas
    • Fine Print
  • Topics
    • Insurance
    • Enterprise Risk Management
    • Strategic Risk Management
    • Natural Catastrophes
    • Cyber Risk
    • Pandemics
    • Emerging Risks
    • International
  • Blog
  • Digital Issue
  • Subscribe
  • RIMS.org
  • Home
  • 2012
  • August
  • 29
  • Finance Isn’t Science: Why Wall Street’s Models Will Always Have Limitations

Finance Isn’t Science: Why Wall Street’s Models Will Always Have Limitations

Katherine Heires
August 29, 2012September 13, 2012 10 Comments
Emanuel Derman

JPMorgan Chase’s multi-billion-dollar trading losses earlier this year due, in part, to the firm’s over reliance on a “value at risk” model put Wall Street’s love affair with models in the spotlight. Since the financial meltdown in 2008, more and more experts, including Emanuel Derman and Nassim Nicholas Taleb, have criticized how the sector uses models.

Derman, a professor at Columbia University and former head quant for Goldman Sachs, is outspoken on the limitations of modeling and the need for risk managers, along with CEOs, CFOs, financial engineers and traders, to keep their enthusiasm for modeling in check. “There isn’t a short cut or mechanical formula that will help you figure out the right price for a financial product,” said Derman in an interview, adding that, “these financial models are only trying to capture human emotions and instinctual feelings that we use to help us determine prices in financial markets. They are not absolute things like the distance from here to there or here to the sun, where everyone agrees on the distance.”

In a presentation he gave before financial engineers earlier this year, Derman further explained how his view of financial modeling both coincides and differs from that of Taleb, author of The Black Swan. “Like Taleb, I think of many models as junk,” said Derman in his presentation. But he also pointed out that, “unlike Taleb, I believe that you can’t live without models.”

He views select ones, such as the Black-Scholes model for option pricing, as valuable and extremely well constructed. And he sees other, less-ambitious models as simply helpful, time-saving tools. Since he, along with industry pioneers Fischer Black and Bill Toy, developed the Black-Derman-Toy model, a landmark interest rate calculation still used today for bond options and interest rate derivatives, this appreciation should come as no surprise.

But his views on the limitations, which he lays out in his 2011 book Models.Behaving.Badly, are similarly rooted in first hand experience. In the book, Derman discusses growing up in Apartheid South Africa and observing the failed political and social structure models there. He also recounts the impact of his experience of moving to the United States, where he earned a Ph.D. in theoretical physics from Columbia University.

In light of his studies of physics and the material world, he carefully differentiates the development of scientific theories based on inanimate matter from the construction of financial models that must contend with the complexities and uncertainties of human behavior. But this was not always the case. When he first began as a quant on Wall Street, he believed, for awhile at least, that it was possible to apply physics successfully to finance. But after 20 years on Wall Street, Derman became a determined disbeliever.

“When I came out of physics, back in 1985, I really did believe, naïvely, that financial modeling could be like physics modeling and that there might be a grand unified theory of interest rates,” said Derman. He believes that having the opportunity to work with a realist like Fischer Black helped him change and evolve his thinking. “Black did not think that way. He clearly understood the limitations of models, and he was closer to the real world than many other academics.”

Emanuel Derman, author of My Life as a Quant, breaks down the difference between scientific and Wall Street models. “In physics you’re playing against God, and He doesn’t change his laws very often. In finance you’re playing against God’s creatures: agents who value assets based on their ephemeral opinions.”

Derman clarifies his thinking on the matter this way: “The similarity of physics and finance lies more in their syntax than their semantics. In physics you’re playing against God, and He doesn’t change his laws very often. In finance you’re playing against God’s creatures: agents who value assets based on their ephemeral opinions. The truth, therefore, is that there is no grand unified theory of everything. In finance there are only models of specific things.”

Models, according to Derman, are a kind of caricature, a metaphor of limited applicability that is not as dependable as, say, James Clerk Maxwell’s equations for electromagnetic theory. They are metaphors that compare the object of their attention to something else it resembles. But in doing so, they are simplifications and reduce the dimensions of the world. Derman describes them as trying “to squeeze the blooming, buzzing confusion into a miniature Joseph Cornell box.”

This is in stark contrast to theories that, Derman says, are attempts to discover the principles that drive the world. “In a nutshell, theories tell you what something is,” he said. “Models tell you merely what something is like.”

Derman singles out economists as a big part of the problem and a source of confusion on Wall Street regarding the limitations of models. He believes they often fail to understand the difference between dependable theories and less-than-dependable financial models.

“If you open up the prestigious Journal of Finance, one of a select number of journals in which finance professors must publish in order to get tenure, many of the papers resemble those in a mathematics journal,” said Derman.

But for all the axioms, theorems and lemmas economists produce, he views them as largely useless. “The advantage of having studied physics,” said Derman, “is that you have seen really good models and you know the difference between a really good model and those that are not so great. The trouble for people coming out of economics is that they have the disadvantage of never having seen a model that is truly great and, therefore, can’t tell when something is really bad.”

While Derman is firm in his belief that a better understanding of models would not have necessarily prevented the financial crisis—a claim that many made right after the crisis—he is optimistic that his message about the vulnerability of models is an important one, particularly for young people entering the financial field.

“You should not hang all the people making financial models, though they did play a part in people valuing mortgage derivatives in a naïve way,” said Derman, adding that people at respectable firms on Wall Street generally do understand the limitations of models and their proper use.

Instead, he hopes that those tasked with building and using models in the future—especially those with a tendency to be excessively enamored with the beauty of mathematical models—will learn to better understand what a model’s place should be. And that is why he tries to teach his students to “come to understand that models are not some machine that you can just crank up and it gives you the right answer,” said Derman. “Some of them look at a fancy-looking model and think it must be accurate. But often, it’s not and there isn’t some magical formula.”

Post navigation

Creating Value with ERM at Paychex
The Value of Knowledge Management Programs

Related Articles

oroville dam infrastructure risk America's Crumbling Infrastructure

Oroville Dam Highlights Infrastructure Risks

Caroline McDonald
April 3, 2017April 3, 2017 No Comments
Risky Forecast

The Challenges of Hurricane Forecasting

James Waller
May 2, 2016April 15, 2016 No Comments
hurricanes climate change Looking at Losses

Hurricanes and Climate Change

Caroline McDonald
August 3, 2015July 27, 2015 No Comments

10 thoughts on “Finance Isn’t Science: Why Wall Street’s Models Will Always Have Limitations”

  1. Joseph Tramontana says:
    February 3, 2014 at 3:09 am

    Thanks a lot for sharing this, Katherine. The problem with theories and models is that they can be wrong. It's not accurate 100% of the time. Limitations will always be a part of it, what we can do is to try to come up with a solution to those limitations.

    Reply
  2. Pingback: Emanuel Derman – The World is NOT a Model | #Ideas
  3. Phillip says:
    April 16, 2014 at 7:02 am

    Great post Katherine! I see financial models as algorithmic procedures which involve protocols that have to be abided by until an end data results. However, many people have their own views which help them work to the best of their ability in a numerical fashion.

    Reply
  4. Dan Craig says:
    June 22, 2014 at 4:36 pm

    Really informative post Katherine. The world of finance is a complex place. Interesting read, thanks.

    Reply
  5. jenis bisnis rumahan says:
    July 25, 2014 at 4:00 am

    The problem with theories and models is that they can be wrong. It's not accurate 100% of the time. Limitations will always be a part of it, what we can do is to try to come up with a solution to those limitations.

    Reply
  6. jelly gamat says:
    December 3, 2014 at 7:34 pm

    yes i agree with derman, you can not live without a model, and I think all good models only way any less correct application.

    Reply
  7. juki says:
    March 1, 2015 at 2:06 am

    The problem with theories and models is that they can be wrong.
    However, many people have their own views which help them work to the best of their ability in a numerical fashion.

    Reply
  8. peluang usaha says:
    April 2, 2015 at 2:16 am

    EMANUEL DERMAN, I know he is a remarkable person

    Reply
  9. Mudkats says:
    August 27, 2015 at 10:03 pm

    His views on the limitations, which he lays out in his 2011 book Models.Behaving.Badly, are similarly rooted in first hand experience and very interesting indeed

    Reply
  10. Elhouzz Blog says:
    October 4, 2015 at 11:21 pm

    thanks for sharing..
    The world of finance is a complex place. Interesting read, thanks.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

one × two =

Current Issue

Don’t Miss Out

With many continuing to work remotely, keep in mind that you can always update your mailing address by clicking here to ensure future issues of Risk Management are sent directly to you.

RSS Risk Management Monitor blog

  • Six Considerations Impacting Strategic Regulatory Change Management April 9, 2021
  • RIMS LIVE 2021 Keynote Duncan Wardle on Out-Of-This-World Innovation April 5, 2021
  • Women in Risk: Advice for Advancing Female Risk Professionals Beyond Women’s History Month April 1, 2021
  • Data Backup Strategy Tips for World Backup Day March 30, 2021
  • Texas Cold Crisis: Insurance Options for Severe Weather Disruption March 3, 2021
Copyright 2020. All rights reserved | Theme: OMag by LilyTurf Themes
  • About
  • Subscribe
  • Advertise
  • Contribute
  • Editorial Calendar
  • Contact
  • Privacy