Slashdot Log In
Trading the Markets With FOSS Software?
Posted by
timothy
on Thu Sep 18, 2008 07:34 PM
from the free-markets-deserve-free-software dept.
from the free-markets-deserve-free-software dept.
Robert writes "Along with many other techies, I share an interest in the world of finance (bubble-era stock options pulled me in). Unfortunately, as someone with a strong preference for GNU/Linux as my operating system of choice, I have found that software in this area seems quite sparse. For awhile I have made do with Python, R, Gnumeric, Gnucash and a telephone, along with some small utilities I have written myself. What I would like to know is: what FOSS software do you use for financial analysis, trading, system development, and testing in a Un*x environment? Are there programs you would like to see written or ported? Do any brokerages, data providers, or other services provide good support for we the few? And finally, what commercial entities do you know of that are using FOSS software in their operation?"
Related Stories
Firehose:Trading the Markets with FOSS Software? by Anonymous Coward
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
The best tool... (Score:5, Funny)
is a dartboard.
It's unfortunately not available on most distros, but building yourself isn't too hard.
The dependencies are merely a wall, and Newton's three laws of motion.
Hmmm (Score:4, Interesting)
Lehman, Merrill, AIG, HBOS all used lots of FOSS IIRC.
Screw automated trading; screw Ben Bernanke, screw McCain-Bush. I'm going to be foreclosed because I lost my job in the operations dept at Merrill and I can't refinance my mortgage. Why should they get a bailout? Quants screwed over my life and I want them to pay.
Re:Hmmm (Score:5, Funny)
Did you lose billions of dollars in the stock market? Don't have enough cash to cover your debts? Call the Federal Reserve hotline! You could have $85bn in your checking account by tomorrow, no collateral or responsibility required! 1-800-FED Call now and we'll start a commission to get investors off your back for free!*
*offer applies with enrollment in triple advantage and is subject to a vote for John McCain
Parent
Re:Hmmm (Score:5, Funny)
Parent
Re:Hmmm (Score:5, Funny)
Maybe Man U can get Uncle Sam to assign an Apache gunship to defend their goal during matches. God knows they need it.
Parent
Re:Hmmm (Score:5, Insightful)
The federal reserve isn't owned by the US taxpayers. It's a private company.
Parent
not really (Score:5, Informative)
It's a complicated public/private structure, and basically anything less than a book-length explanation of it oversimplifies in one way or another. It's the de facto U.S. central bank, and the main federal agency regulating banking, but also has significant private components. Its funding sources are technically ownership and fees by various private banks, but restricted in such ways that it's de facto more like government regulation and bank taxes than ownership and fees between private entities. Its board of governors are appointed by the President, and confirmed by the Senate. It's also effectively an operational arm of the U.S. Treasury for everything from tax collection to paper-money supply to treasury-bond issuance and interest payments.
More to the point, its solvency is implicitly guaranteed by the U.S. government, much like that of Fannie Mae and Freddie Mac were (and those two quasi-private entities were actually de facto considerably more private than the Fed is).
Parent
Re:Hmmm (Score:5, Interesting)
You do know a 3-month T-bill was, at one point earlier this week, yielding less than par value? People were buying US government bonds guaranteed to lose money because of the fear that everything else would lose more value.
Parent
Re:Hmmm (Score:5, Insightful)
That's the rub. Many businesses go out of business, some of them more spectacularly than others, and there was no mention of a government bailout of them now was there. It is the same asshats that scream "Free Market" when they perceive a wrong against the corporation that are now screaming to not allow the market to work as it should. AIG knew the market risks when they offered their IPO. Investors knew the risks when they purchased the stock. The company certainly knew the risks when it lobbied Congress to change the laws and lastly the Congress knew the risks when it deregulated everything at the behest of the company. Why should the public be forced to take on the risk these same asshats assumed solely because the asshats screamed "free markets" to get the regulations that would have protected the public voided and the agencies charged with oversight gutted? You didn't see AIG investors protesting the profits they were getting when times where better so why protest when they go belly up? It is corporate welfare pure and simple.
Parent
Re:doofus (Score:5, Interesting)
All the little stockholders at AIG are getting the shaft.
Uh, I think that was a foregone conclusion when they hired inept management.
It was essential that every stockholder in AIG lose virtually everything they invested. Otherwise it becomes profitable to mismanage your company and let Uncle Sam buy you out.
I think that some of these resuces were necessary for the good of the greater economy. Sure, they shouldn't be necessary, but regulators messed up and now for the sake of not collapsing into a depression we need to clean up.
If I were in charge the only thing I'd do differently when doing bailouts like these would be:
1. Company is 100% taken over.
2. Stock is declared void. Stockholders get a 1-time eminent domain payment of (value of company assets)-(cost to taxpayers for bailout)/(# shares outstanding). Frankly the stockholders should be happy they don't end up owing money which is what the math certainly will work out to.
3. Corporate officers arrested and face heavy criminal penalties. Costing the taxpayers billions of dollars needs to be made a serious crime. It is certainly worse than robbing the corner store.
4. Government runs company in such a way to preserve the general economy.
5. Eventually company is either dissolved or IPO'ed - with all proceeds going to taxpayers.
If this were how bailouts worked you wouldn't see too many executives asking for them.
Don't get me wrong - the preference is in general to let companies just go bankrupt and not interfere. But, if interference is needed for the greater good than this is how it should be done.
Parent
Re:Hmmm (Score:4, Insightful)
You can blame a lot on Bush, including the terrible budgeting since that's an executive job, but the economy, not so much. Not unless you're a tool of Nancy Pelosi and Reid. I know it's popular around here to blame everything on Bush, but get the facts. Be enlightened.
Parent
Re:Hmmm (Score:5, Insightful)
Well, you have some facts skewed and some misplaced causality.
In 1999, Republicans wanted less regulation, causing investment banks to make create financial derivatives to hide risk and gain back their margins and bonuses, where normal banks could now compete.
Second of all, remember Bush touting the "Ownership Economy" where the sub-primes had artificially elevated the percentage of citizen's who lived in homes they owned?
Hardly sounds like a left-wing plot of the Democrats altering private banks attitude of lending via mind-control.
Less regulation, market forces, and human animus(greed, aggression, and fear), which if totally unchecked/balanced by other concerns can spell disaster.
Parent
Re:Hmmm (Score:5, Insightful)
Read this 2003 NY Times article [nytimes.com] about Republican efforts to increase regulation of Fannie Mae and Freddie Mac. There is plenty of blame to go around. Here's a little snippet from the article:
Among the groups denouncing the proposal today were the National Association of Home Builders and Congressional Democrats who fear that tighter regulation of the companies could sharply reduce their commitment to financing low-income and affordable housing.
''These two entities -- Fannie Mae and Freddie Mac -- are not facing any kind of financial crisis,'' said Representative Barney Frank of Massachusetts, the ranking Democrat on the Financial Services Committee. ''The more people exaggerate these problems, the more pressure there is on these companies, the less we will see in terms of affordable housing.''
Representative Melvin L. Watt, Democrat of North Carolina, agreed.
''I don't see much other than a shell game going on here, moving something from one agency to another and in the process weakening the bargaining power of poorer families and their ability to get affordable housing,'' Mr. Watt said.
I'm not a proponent of either party - and so I think it makes it easier to see that they are both grossly incompetent for the most part.
Parent
Bush is still culpable (Score:5, Insightful)
That, most definitely, happened on Bush's watch. The "laissez-faire" philosophy of the republicans sounds and looks a lot like Hoover right now. They have, literally, let Wall Street run itself. And you can see the end result on the front pages everyday. Whats the saying? Power corrupts and absolute power corrupts absolutely.
Look, I am no regulation lover but even the staunchest of conservative economists recognize free markets must have some regulation to insure a fair playing field. Under this administration -- there has been NONE.
Do you realize that many firms were allowed to leverage up 30 to 1? Let me break down what that means for the
That is totally fucked up and should have never happened. End of story.
Parent
Yes, I do realize it (Score:5, Informative)
Management of the leverage is what is missing here. NO FIRM should be allowed to leverage up 30:1. (30x your collateral)
You are comparing apples and oranges.
And since you went there with LTCM [wikipedia.org]....allow me to quote you a figure, "At the beginning of 1998, the firm had equity of $4.72 billion and had borrowed over $124.5 billion with assets of around $129 billion. It had off-balance sheet derivative positions with a notional value of approximately $1.25 trillion"
Management of leverage was obviously missing there. 1.25 trillion? That is absolutely totally fucking insane. But because Merriweather was a "smart guy" --- the investment banks let him do this. And it put the entire system at risk.
That's not supposed to happen. Ever. Yet it did. Do we learn nothing from history?
Parent
Re:Hmmm (Score:5, Interesting)
You need to inform yourself. First of all, the housing bubble was primarily fueled by errors on Wall Street, not Washington. The explosive growth of the mortgage-backed security industry created an environment that gave people lots of incentive to do really stupid things, like loan people money without requiring them to invest significantly in what they were purchasing or demonstrate that they had the money to pay back the loan. Secondly, here [businessweek.com] is just one of many available articles explaining that the really big hit has come from borrowers with good credit ratings and sufficient cash flow who simply do not wish to continue to pay the mortgage on a house that is no longer worth nearly what they paid for it. It turns out that you can default on your mortgage and all they can take is your house, not your other assets (who knew?).
Anyway, it's certainly not "authoritative," but here [google.com] is a funny and true cartoon that does a pretty fair job of explaining how the screwed up incentives turned normal people in financial fuck-up machines.
Parent
Predicted in 99 (Score:5, Informative)
Interesting speech from Senator Dorgan when the bill, Financial Services Modernization Act, was being discussed '99. Those who don't know history...
"I remember a couple of circumstances that existed more recently. I was not around during the bank failures of the 1930s. I was not around for the debate that persuaded a Congress to enact Glass-Steagall and a range of other protections. But I was here when, in the early 1980s, it was decided that we should expand the opportunities for savings and loans to do certain things. And they began to broker deposits and they took off. They would take a sleepy little savings and loan in some town, and they would take off like a Roman candle. Pretty soon they would have a multibillion-dollar organization, and they would decide they would use that organization to park junk bonds in. We had a savings and loan out in California that had over 50 percent of its assets in risky junk bonds.
Let me describe the ultimate perversion, the hood ornament on stupidity. The U.S. Government owned nonperforming junk bonds in the Taj Mahal Casino. Let me say that again. The U.S. Government ended up owning nonperforming junk bonds in the Taj Mahal Casino in Atlantic City. How did that happen? The savings and loans were able to buy junk bonds. The savings and loans went belly up. The junk bonds were not performing. And the U.S. Government ended up with those junk bonds.
Was that a perversion? Of course it was. But it is an example of what has happened when we decide, under a term called modernization, to forget the lessons of the past, to forget there are certain things that are inherently risky, and they ought not be fused or merged with the enterprise of banking that requires the perception and, of course, the reality--but especially the perception--of safety and soundness.
Last year, we had a failure of a firm called LTCM, Long-Term Capital Management. It was an organization run by some of the smartest people in the world, I guess, in the area of finance. They had Nobel laureates helping run this place. They had some of the smartest people on Wall Street. They put together a lot of money. They had this hedge fund, unregulated hedge fund. They had invested more than $1 trillion in derivatives in this fund--more than $1 trillion in derivatives value.
Then, with all of the smartest folks around, and all this money, and an enormous amount of leverage, when it looked as if this firm was going to go belly up, just flat out broke, guess what happened. On a Sunday, Mr. Greenspan and the Federal Reserve Board decided to convene a meeting of corresponding banks and others who had an interest in this, saying: You have to save Long-Term Capital Management. You have to save this hedge firm. If you don't, there will be catastrophic results in the economy. The hit will be too big.
You have this unregulated risky activity out there in the economy, and you have one firm that has $1 trillion in derivative values and enormous risk, and, with all their brains, it doesn't work. They are going to go belly up. Who bears the burden of that? The Federal Government, the Federal Reserve Board.
We have the GAO doing an investigation to find out the circumstances of all that. I am very interested in this no-fault capitalism that exists with respect to Long-Term Capital Management. Who decides what kind of capitalism is no-fault capitalism? And when and how and is there a conflict of interest here?
The reason I raise this point is, this will be replicated again and again and again, as long as we bring bills to the floor that talk about financial services modernization and refuse to deal with the issue of thoughtful and sensible regulation of things such as hedge funds and derivatives and as long as we bring bills to the floor that say we can connect and couple, we can actually hitch up, inherently risky enterprises with the core banking issues in this country.
I hear about fire walls and affiliates, all these issues. I probably know less about them than some others;
Parent
EclipseTrader (Score:5, Informative)
EclipseTrader [sourceforge.net] is probably the most advanced open source trading program. It interfaces with some trading platforms and intra-day data feeds. It has several hundred technical indicators. It also is very expandable and easy to write modules for (in Java). I wrote some technical analysis modules for the back-testing system and was fairly impressed with how well it worked as it is based on the very solid OSGI/Eclipse model. I'd say it actually competes fairly well with some of the proprietary trading platforms I have used, especially if you are a Java coder and want to add modules to it to aid in implementing your particular trading style.
Re:EclipseTrader (Score:4, Informative)
Last time I tried EcT it consistently crashed on my Gentoo machine without warning, and it consumes unholy amounts of memory. I never trusted it enough to actually use it as a trading platform. For keeping an eye on your accounts and whatnot it's fine, but unless they've made heroic strides in the past five months, it's probably still unstable. And for that particular purpose I can use the excellent only Google interface.
The community around it is also rather thin, and (IMO) actually downright hostile to recommendations and bug reports.
Frankly, I'd rather trust being able to burst a sell order to an application that a company has spent a few millions developing and actively supports than to a "community project". So far I haven't had any problems with the former. Sure, I have to dual boot into Windows (no WINE for the one I use, at least not yet), but this is my livelyhood we're talking about.
Parent
Tons of stuff out there: (Score:5, Informative)
I understand that the submitter doesn't know what is out there, but if you ever have a trading account you're likely to have API access to your broker's systems. I recommend Interactive Brokers as their TWS software has a lot of different language bindings.
In finance you don't look for "FOSS" tools, you go to your broker, get API access, and write them yourself.
Interactive Brokers's Java trading platform (TWS) (Score:5, Informative)
Interactive Brokers [interactivebrokers.com] has a Java-based
Trader Workstation [interactivebrokers.com] ("TWS") and they explicitly support Linux. They offer almost anything you can get anywhere, including mutual funds, stocks, options, futures (commodity & financial), currency, and foreign stocks. Commissions are 10x lower than Charles Schwab if you trade often (if you don't then a minimum monthly commission kicks in).
TWS is a large, cumbersome Java applet, but it works tolerably well on a fast machine (and there's not much alternative on Linux)
One annoyance is that they only support jdk 1.5.0_x (not the current 1.6.x), I think because of some concurrency bugs in their code (they claim the newer Java is buggy). However TWS generally does work with the latest jdk, but they won't support it.
IB's telephone support is sometimes rude, the opposite of "hand holding". I guess they have only a few over-worked support people to keep costs down. Also, they only provide on-line statements and never send physical mail except for annual 1099 tax forms. So, be sure your spouse/executor knows you have an IB account, because if you die there will be no monthly statements to clue them!
In summary, IB is good, despite their warts. If you trade a few times a month or more, it's worth the hassles.
Well, since I develop trading systems on FOSS (Score:5, Informative)
That is the trading system I've spent several years working on is built entirely using Open Source tools and libraries. The system itself is not currently open, but that is a possibility we here certainly look favorably at.
As far as actual entire free trading systems, there is JavaTraders@googlegroups.com which is a good place to start. Also check out the quickfixj.org site, you will find some things there. There is also an Eclipse plugin which provides some level of GUI.
Frankly we didn't any of the code in any of those projects (although we do use ta-lib). But as I say, you can do a lot with ActiveMQ, any good open source RDBMS (PostgreSQL,MySQL) and your Enterprise Java framework bits of choice.
Basically if I were you I'd pick one of the java based projects that is kicking and does roughly what you want, the way you want to do it. For simple basic trading of one or two instrument classes you can probably put together something pretty workable.
Re:The NYSE runs linux (Score:5, Insightful)
Parent
Re:The NYSE runs linux (Score:5, Informative)
That's nice, but I think he's more interested in analysis and management tools rather than actually running a stock market...
I think you're right. Here's a list of apps from something I just googled. [linuxlinks.com]
Parent
Re:Let me save you the trouble (Score:5, Informative)
Areed. I spent 3 months trying to find a good solution. If you've got buckets of money, NxCore ( http://www.nanex.net/NxCore/NxCore.htm [nanex.net] - prices start at $500/month) and any of the brokers that support a FIX API (for which you can expect to pay a hefty fee, too; Interactive Brokers (IB - http://www.interactivebrokers.com/ [interactivebrokers.com] ) for example charge a one time $500 fee, OANDA ( http://www.oanda.com/ [oanda.com] ) charge $600 for the first two months then an ongoing subscription fee if you trade $12mil/month or something).
For those people not wanting to pour money into it, as good as you can get is Interactive Broker's Trader Workstation (TWS), and JBookTrader (http://code.google.com/p/jbooktrader/) or a custom trading platform that talks to their API. TWS is a pain that lacks automated login (for security reasons) and auto-exits every 24 hours (for... err... security reasons?), but it gets the job done. Data feed can be an issue still, though; IB offer up to 100 symbols at a time, and a basic historical data service, but some people dislike the fact they drop price ticks during busy market times (over 10 prices per second) and the historical data service is paced so you can only do a limited of number of requests (about one every ten seconds I believe).
In short though, AC is right; use Windows, it may well be less painful. Really.
Parent