Share This

Sunday 28 February 2010

Scientists Develop Financial Turing Test

Can humans distinguish between sequences of real and randomly generated financial data? Scientist have developed a new test to find out.
Various economists argue that the efficiency of a market ought to be clearly evident in the returns it produces. They say that the more efficient it is, the more random its returns will be and a perfect market should be completely random.

That would appear to give the lie to the widespread belief that humans are unable to tell the difference between financial market returns and, say, a sequence of coin tosses. A number of experiments seem to back up this belief, showing for example that humans studying randomly generated data very quickly identify 'trends' in the data and develop hypotheses about them.

To find out whether humans can reliably distinguish between real and random market data, Jasmina Hasanhodzic at AlphaSimplex, an investment strategy company in Cambridge, Mass, Andrew Lo at MIT's Sloan School of Management, who founded AlphaSimplex and Emanuele Viola at NorthEastern University, have devised a simple experiment.

They have created a computer game in which a player is shown two time-series of data. One is real data from a financial market such as the US Dollar Index, or the spot price of Gold. The other is the same data randomly rearranged. The player has to guess which is the real series and is immediately told whether the guess is right or wrong.

Hasanhodzic and co call this a financial Turing test and anybody can sign up and take the test on their website.

In their experiment, 78 people took the test, with each contest lasting two weeks.

The results show that that humans are actually rather good at this game. After a few guesses most people quickly learn how to distinguish the real data from the random stuff. "The results provide overwhelming statistical evidence (p-values of at most 0.5%) that humans can quickly learn to distinguish actual price series from randomly generated ones," say Hasanhodzic and co.

It's not hard to see why. In feedback sessions, the players say that the real data was smoother than the randomised data or vice versa and that these patterns were easy to spot after a few goes.

That's an intriguing result but what to make of it? First let's look at what the study does not address. The study does not address any notion of predictability. A truly random market is entirely unpredictable, by definition.

There is good evidence that real markets are not random and that their behaviour can be described by fairly simple principles. That doesn't make them predictable, however (although we have looked at evidence that certain kinds of bubble markets might be predictable here, here and here).

Neither does the study address whether humans are good at making predictions; whether they are better at predicting the future performance of a market than, say, a coin toss.

So what does it show? It shows that humans are good at pattern recognition. Nothing more and nothing less.
Ref: arxiv.org/abs/1002.4592: Is It Real, or Is It Randomized?: A Financial Turing Test

Source: http://newscri.be/link/1029198

Comments

  • It may mean a lot more. . .
    ". . .It shows that humans are good at pattern recognition. Nothing more and nothing less. . ."

    Not so fast. We are talking about MARKETS and the behavior/participation of its various players. And above it all, we have Economic Theories of various types that inform/underpin/hope-to-influence national and global economic policy. And let's not forget that we almost had Depression 2.0

    I often hear economists talk about 'Rational Market Behaviour'. Thing is, that supposition evolved from a time when Traders looked at Ticker Tapes and made their own 'wetware' based analysis of stock trends which were generally based on the common sense desire of companies and their shareholders to have their holdings increase in value-- at which said trader would grab a phone and yell out an order up or down.

    Today-- not only do we have these same trades being executed by computers within seconds, we now have trades being executed algorithmically for mathematical reasons that have nothing to do with company/product trends or even inside info and more to do with graphical stock microjumps up or down. Just a pure 'For X delta, execute Y Action times Z number of stocks'. It doesn't matter if the company makes CPU's or makes Tampons.

    And I'm sure that quite a few of you with PURE Tech stocks may have had a prolonged WTF moment that lasted for DAYS as you watched your beloved stock dive for the oceanic abyss despite it having NOTHING WHAT-SO-EVER to do with Subprime Mortgages. There was NOTHING 'Rational' about it. Nor was it ALL Human wetware Irrationality. 

    Couple that with whole banks of Trading Servers taking the Market on Upward Swoops and deathdefying dives inside a single day with NO MAJOR ECONOMIC NEWS. . .coupled with increasing possibility of Gov't scrutiny on so-called 'Program Trades' this notion of a Financial Turing test could be a match being lite in a dusty room full of dynamite.
    Rate this comment: 12345

    Marrach
    02/26/2010
    Posts:3
    Avg Rating:
    3/5
  • I already built this.
    Three years ago I ran Stock Or Not - 100k games were played. My results were public. http://www.felixsalmon.com/000763.html
    Rate this comment: 12345

    jdigittl
    02/26/2010
    Posts:2
    Avg Rating:
    5/5
  • reinvent the wheel
    So did they actually use Josh Reich's code or simply stumble upon the same idea?
    Rate this comment: 12345

    jd long
    02/26/2010
    Posts:2
    • Re: reinvent the wheel
      I don't claim to be that smart, its a pretty obvious idea. And theirs has Java! mine was cobbled together from bash scripts + R.

      Here is my R code http://i2pi.com/rez/stockOrNot.R
      Rate this comment: 12345

      jdigittl
      02/26/2010
      Posts:2
      Avg Rating:
      5/5
      • Re: reinvent the wheel
        Java, cool! That's so enterprizey! ;)

        Yeah I know it's not exactly novel. But if they got the idea from your game it would have been cool to at least give you a nod.
        Rate this comment: 12345

        jd long
        02/26/2010
        Posts:2
  • EURUSD price line and your predictability
    The current crisis is a crisis linked to the possibility of building high technological products, only possible today. Result of the accessible massive processing and the large data storage available.
    This technological phenomenon as discussed above in the comments, causes meetings between algorithms and makes it sound patterns. They seem random, if we do not see what is going on. There are varying degrees of leverage and space-time. Minor leverages more time and space, opposite is the reverse. All that is smaller than a measure of a day are noisy routines. It is known that all uses standard margins and margin calls. Most of the algorithms act at the beginning or at the end of movements, therefore, most of all buy and sell at the same time, even using the same lagging indicators and/or similar algorithms. With some simple math, one can predict how big is the next step, but not the direction. When a movement starts, just stop in the next step, will never be in the middle ...
    It is a war between powers ...
    Sorry for my poor English.
    Rate this comment: 12345

    lleal2000
    02/26/2010
    Posts:1
Reply
Posted by at No comments:

Saturday 27 February 2010

Professional financial planners

 Expert advice, not pushing products, is the key

FINANCIAL planning (FP) should be viewed as a profession where unbiased and independent advice is provided to clients covering all personal financial matters and services.

However, the FP industry in Malaysia, which is still in its infancy stage compared with their counterparts in other advanced countries, is grappling with issues such as wrong public perceptions and lack of product innovation as well as FP tools.
"In short, it involves advice first, products second and services thereafter" ROBERT FOO
 
According to MyFP Services Sdn Bhd financial planner and managing director Robert Foo, the financial planning model follows a six-step process which involves building a relationship with the client, gathering the client’s personal data as well as financial goals, analysing the data, recommending and implementing solutions besides tracking that the client’s goals are eventually met.

“In short, it involves advice first, products second and services thereafter,” Foo concludes.

However, Foo notes that the Malaysian public tend to view FP practitioners as no more than product salespersons with FP qualifications.

“Hence, there is little trust on the advice given by many of these “professionals” although they are licensed by the Securities Commision (SC) or Bank Negara. They are perceived to be biased. At the back of their (the public) minds, financial planners are perceived to be out to make sales commission from selling as many products as possible,” Foo notes.

When the FP profession started to take root in Malaysia around 2001, the majority who took up FP qualifications were insurance and unit trust agents.

“Many of those qualified are still adopting a multi-level agency sales approach to their business and the emphasis and compensation is solely based on product sales and commission,” Foo adds.

Foo says the problem still exists due to the tied agency system where individual financial planners or analysts can only recommend products from a single provider.
"Their solutions are domestically myopic when the clients they target have already gone global" JEREMY TAN
 
To mitigate this problem, an institutionalised agency system called Corporate Unit Trust Agent was established where licensed financial planners or analysts can distribute products from multiple providers.
“But if you look at the response to this ‘innovation’, only four entities (product providers) have applied, which is not what individual financial planners want. This, in turn, hinders the development of the FP profession,” Foo adds.

Due to a lack of enforcement, scores of individuals are holding themselves out as financial planners or advisors without a licence.

“Some even have FP qualifications but are not licensed by SC or Bank Negara. Most of these are sales and product agents who want a little credibility with these professional sounding labels,” Foo notes.

Jeremy Tan, a licensed financial adviser with Standard Financial Planner Sdn Bhd, agrees that many equate financial planning with unit trust investment and insurance planning.

In reality, financial planning involves a holistic planning of one’s finances throughout the different stages of one’s life (family inclusive). This is a more wholesome approach and encompasses wealth management, its protection, distribution and wealth accumulation on an independent basis.

“Unit trust investment and insurance are among the vehicles in holistic financial planning, but they are by no means exhaustive,” Tan adds.

Another concern is the lack of accessibility to product innovations and solutions, which are available overseas, but not available to retail clients here. This limits the development of the FP industry.

Many clients recognise the options and opportunities overseas and have actually channelled a large amount of their money abroad for offshore product options.

“How do you expect the Malaysian FP practitioners to prosper? Their solutions are domestically myopic when the clients they target have already gone global?” Foo adds.

The local FP industry also lacks the tools required to provide the necessary comprehensive advice and services irrespective of whether the client’s assets have remained on Malaysian shores or gone global.
“Currently, there are almost no competitively priced and reliable tools available to these growing boutique firms to serve their globally oriented clients,” Foo says.

Coupled with the tied agency system, practitioners do not see the usefulness of such a comprehensive and globally-oriented system, Foo notes.

Financial planners agree that there need to be concerted efforts by the regulators and FP practitioners to have expos and public forums to create awareness.

“The caveat here is that it should be clearly about FP advice and not about products. Otherwise the confusion will persist,” Foo says.

Advisory practice standards should also be set to ensure that the FP practitioners provide their advice professionally. The client’s interest should be placed first.

“But standards set should not stifle the innovation and creativity of the different business models used by FP practitioners,” Foo notes.

More importantly, there is a need to open up the market for greater competition such as in the United States, Britain and Australia; this will benefit the public in the long run.

This includes making available offshore funds and products via various forms of distribution channels on a “willing buyer willing seller” basis.

“Investment and protection are two of the most important financial concerns for Malaysians and the public should get the best advice and options for their financial future,” Foo concludes.

By LAALITHA HUNT, laalhunt@thestar.com.my

Posted by at 1 comment:

That idyllic home for retirement

RETIREMENT is sometimes defined as the point in life when we stop spending the majority of our time at work and begin living life.

Once our retirement celebration is over, most of us will spend more time staying at home. It will be natural for us to retire in a familiar area close to family, friends, church, neighbours, shopping and other amenities in the neighbourhood. Hence, our dwelling place becomes exceedingly important to us.

During the early stages of retirement, those who can afford to upkeep the house and even hire a maid to take care of it, may not be under financial pressure. But if your retirement savings are depleting year after year and you are not making enough money from investment portfolios, your house can become a financial burden.

Few of us can think objectively about retirement and old age. Any decision to move or to ‘stay-put’, even after a fall or a health problem would precipitate some trauma.

Having to leave a comfortable home and adjust to unfamiliar surroundings – especially when the choice is not ours is frightening. Uprooting would mean “taking away” our sense of belonging and an immediate isolation from family and friends.

There are initiatives overseas in providing appropriate housing for elderly people within community living – a form of ‘lifetime home’ without having it identified as “old-folks’ ghettoes”. In a survey amongst the “new elderly” in Denmark, high priority was given to good housing amenities and the ability to stay in one’s own home as long as possible.

As one poignant respondent commented in the survey: “It is important to move while you still can to a place you choose before other people move you to a place they choose.”

While we wait for such amenities to be available in Malaysia, it is important to be clear minded about our “age in-place” during the golden retirement years.

Choose our dwelling place with a conscious intention of simplifying our life, controlling maintenance costs to accommodate our ageing needs and minimising disruption to our living habits. Unless our adult children can take care of all these, it is safer for us to maintain them within our affordability.

It is wise for you to start thinking about it with the following considerations. Although they may not be comprehensive, they serve as a good guide:

a. Financial Considerations 
·Housing loan obligation – housing loan period should not be stretched into your retirement. It can be financially stressful unless you have investment income to pay for it. Your retirement savings are best conserved for living expenses and not loan repayments.

·A loan-free house is a good idea if you plan to sell it in exchange for a cheaper retirement place. The extra cash from the sale will become useful for your ageing needs.

·Live in a house where cleaning and washing can to be kept at the minimum. You don’t want to be spending your retirement money, time and energy on upkeep instead of enjoying your retirement.

·Live in a house that requires low electricity consumption – energy saving lights and good air circulation can reduce lights and air conditioning. The extra money you save on electricity bills can be used to pay your groceries and important living expenses.

·Location of your house is important. One with affordable cost of living for groceries, shopping and eating out can help stretch your dollar. A place with public transport would provide the convenience, and savings on vehicle costs, petrol and parking fees. Remember that at some point in your retirement you might decide to stop driving.

b. Non-financial considerations like family and friends support, community living with leisure activities and availability of medical-assisted care. You wouldn’t want to be lonely and may prefer assisted-care at home or nearby places.

c. If you want to retire abroad, planning with lots of foresight, research and fact finding from people who have experienced retiring abroad is important. You won’t want to fall into the trap of not being able to afford it or find that you regret it because you miss your family and friends in your home country.

A comfortable house is a great source of happiness for your transition to “ageing in-place”.

If not planned properly, it could be an emotional and expensive affair for you and your family members. It is better to think through all possibilities now for a happy retirement dwelling place later!

BY Carol Yip who is a personal financial coach and also founder and CEO of Abacus for Money

 COMMENTS:
  1. Devon Kemp Says:
    March 5, 2010 at 5:11 am   edit I appreciate your effort and the quality of the information you have provided on you blog. This is very educational. I look forward for more updates. I have your post bookmarked. Thanks!
    Reply
  2. ANA CONNER Says:
    March 5, 2010 at 5:44 am   edit Hi. This is a nice post you have here. I love reading your blog that’s why I subscribed to your RSS feed.You have a very good stuff. I really love your post. Thanks for sharing.
    Reply
  3. MAMIE HUMPHREY Says:
    March 5, 2010 at 6:27 am   edit A most thought provoking post. Very interesting thoughts and ideas. I have enjoyed reading it immensely. I have book marked your blog and will return often for updates.
    Reply
  4. Merrill Gross Says:
    March 5, 2010 at 6:48 am   edit I love your post here same as your site. I love the lay out of your template and it compliments with your theme. This is also informative. Your post rocks and I love it.
    Reply
  5. TONYA AGUIRRE Says:
    March 5, 2010 at 7:11 am   edit I usually spend my free time reading online because I believe reading keeps your memory sharp.I found your post very good and educational. I will come back again and check for more updates. Thanks.
    Reply
  6. CHESTER AGUILAR Says:
    March 5, 2010 at 8:13 am   edit WOW!I enjoyed reading your post.This is very educational.Even the layout and graphics.I subscribed to your RSS feeds to get updated with your post.Thanks for sharing.
    Reply
  7. LESTER CASTRO Says:
    March 5, 2010 at 8:31 am   edit Internet is one of the most powerful source of information nowadays. I’m glad that I found your post and I am learning a lot from it. I look forward for more updates.Thank you
    Reply
  8. FOREST RODRIQUEZ Says:
    March 5, 2010 at 9:05 am   edit Thank you for the post. I really like it. Very educational. This is one of the most comprehensive post I read.Thank you for sharing. More power.
    Reply
  9. CHRIS DUFFY Says:
    March 5, 2010 at 9:22 am   edit This is one of the best post I’ve read. I love your post here. Content rich and very educational.I can’t wait for the next updates. More power.Thanks!
    Reply
  10. DARREN GILBERT Says:
    March 5, 2010 at 9:44 am   edit Hello. I read your post and I like it.The information are good and every thing was discussed in details. Thumbs up!More please.LOL.Thanks!
    Reply
  11. ERIKA CHRISTIAN Says:
    March 5, 2010 at 10:17 am   edit I want more!Hey pal, this is cool stuff you have here.Very informative.I’ll keep asking for more!!! Thumbs up!
    Reply
  12. REGGIE SPRINGER Says:
    March 5, 2010 at 10:34 am   edit Hey!This is the best post ever!All the information were discussed in details. I love your post.I’ll keep asking for more!!! Thumbs up!
    Reply





Posted by at 1 comment:
Subscribe to: Posts (Atom)