Downloads.
Historical Tick-by-Tick Data.
TrueFX is the first service that brings you real, dealable prices from real market participants from all the major market makers, with absolutely no intermediary. As a technology company, we can offer you historical tick-by-tick market data, at zero cost to you.
Below, you'll find the major currency pairs with tick-by-tick historical rates starting in May 2009 through recent months. This data is top-of-the-book, tick-by-tick market data, with fractional pip spreads in millisecond detail. All timestamps are based on GMT. Stay tuned more data to come very soon.
Streaming Real-Time Market Data Widget.
The streaming real-time market data widget shows streaming real-time rates. Clean, untouched bid and offer prices are streamed direct from leading market makers. The widget shows ten major currency pairs, but is configurable, with access to 26 currency pairs.
Market Data Web API.
The TrueFX Real-Time Market Data Web API is a simple HTTP query/response protocol used by clients to access the streaming real-time market data available on TrueFX. With the Market Data Web API users can customize the Streaming Real-Time Market Data Widget, build their own widgets, or use and customize the market data to test strategies and algorithms.
Free historical forex tick data
This page is obsolete and no longer maintained. Please head to the Tick Data Suite page for up-to-date tick data content.
The tick data section of eareview is a detailed guide that will lead you through the whole process of tick data backtesting, starting from where to acquire free historical Forex tick data, how to download it and how to use it in backtesting Metatrader 4 expert advisors to obtain a 99% modeling quality. If you’re not sure what backtesting is, it’s probably a good idea to purchase the Metatrader Backtesting and Optimization Course , which is geared toward people that are new to Forex and Metatrader 4 backtesting.
This page is divided into several sections:
In general, backtesting using the data from the MT4 history center might be good enough for EAs that are not scalping or pip hunting. However, if you’re dealing with such an EA or any kind of EA that closes trades within 1-15 pips, even the smallest feed differences might have a very large impact.
The issue is caused by the Metatrader terminal not having access to the real tick data, but only to minute bar data in the best case, which forces it to give your strategy backtest “false” ticks generated through a process of interpolation using the data for the smallest timeframe available. This is most likely not important to an expert advisor that uses stoploss and takeprofit targets of over 100 pips, but in the case of robots that attempt to scalp a few pips here and there, your backtest could be completely misleading.
So, it is very important to try testing using data having a quality that is as high as possible which is why I put together some resources, all of which I use in my backtesting when needed.
Tick data guides.
How to download free tick data – details the download process using several free tick data sources: Dukascopy, Oanda, Pepperstone, Integral, MB Trading and Gain Capital. Downloading Dukascopy tick data with JForex – a guide that provides an in-depth description of the download procedure using the Dukascopy JForex client. Downloading and parsing Dukascopy tick data with Birt’s PHP scripts – a how-to which goes into a lot of detail on the subject using the PHP scripts I wrote for downloading and processing tick data from Dukascopy. How to prepare your tick data for Metatrader 4 – guide to converting the tick data to a format compatible with Metatrader 4 (from CSV to FXT). How to backtest using tick data with Metatrader 4 – a review of the options available for using tick data with the Metatrader 4 platform. How to backtest using tick data – the Tick Data Suite guide – a guide that describes the usage of the Tick Data Suite, the preferred tick data activation method that has a lot of features that its alternative lacks. It is much easier to use and fully supported. See the Tick Data Suite feature matrix for a detailed comparison. How to backtest using tick data – the free Birt’s patch script guide – a how-to that delves into the usage and limitations of the free method that enables tick data backtesting. FAQ & Troubleshooting Downloads.
The Walk Forward Analyzer.
Not directly related to tick data but with built-in support for it, the Walk Forward Analyzer is an excellent tool that lets you optimize your Metatrader 4 expert advisors in steps, in a technique called Walk Forward Analysis. Simply put, you optimize your EA for say 3 months, then you test it for the next 1 month to see if the best parameters resulting from the optimization work fine on out-of-sample data, then you optimize it further on the next 3 months and so forth. This tool lets you automate the whole process and does all the runs for you, providing an exhaustive set of configuration parameters and a neat optimization report at the end. The Walk Forward Analyzer is a must-have for anyone doing serious EA development. But don’t take my word for it, visit the website and download your copy – the WFA used to be priced around $30 but recently the author decided to provide it for free.
Since there are frequent updates to the tick data tools, I decided to keep a Tick data changelog that lists all the changes that the scripts have gone through.
Also, for those interested, the old tick data page is still available but a lot of the information there is now obsolete.
Free historical forex tick data
This page is no longer actively maintained.
Nowadays there are many sources of tick data and this guide attempts to cover some (well, most) of the popular providers where you can download free tick data. You may use the navigational links here to jump directly to your preferred provider or you can read the whole article and decide which source is best for you. Before you ask, I favor Dukascopy due to the data quality and accessibility.
Background.
Dukascopy is universally acclaimed as one of the best brokers nowadays. Personally, I’ve never had a live account with them so I cannot confirm or deny that, but many people classify it as “the best ECN broker” and I have yet to read bad things about them. From my point of view, their major drawback is the lack of a MT4 client (it’s possible to run MT4 EAs, but very tricky). However, if you’re looking for a really solid ECN broker and Metatrader expert advisors are not your kind of cookie, look no further. Their JForex client supports extensive automation but you definitely won’t find as many commercial automated trading systems for that as you can find for Metatrader 4.
By far the most popular tick data source, Dukascopy offers free data spanning from 2003 (for most currencies) to now. Despite being offered at no cost, it’s commercial-quality data and it actually approaches the 99% quality displayed in the strategy tests (which, by the way, is just a number in the FXT header). From what I can tell, it is updated hourly and the source is none other than the Dukascopy data feed server. Bottom line is: I couldn’t wish for a better data quality.
Available currency pairs:
The most convenient method to download from Dukascopy is via the Dukascopy historical data page which features a web application that lets you get the tick data for a specific time range (note: this has been changed in the meantime and it only allows downloading one day at a time; this is obviously not a very convenient method anymore). You will be prompted to select the date format – you may choose whatever format you want for the date, the FXT conversion script will be able to autodetect and parse it.
Some other options for downloading are:
The Tickstory is a free all-in-one tool that not only downloads the Dukascopy tick data but also processes it into an FXT. If you select this route, you no longer need to go through the CSV2FXT conversion step (you can still export a CSV and do it, though) but please note that I do not provide support for Tickstory and in many cases I cannot provide support if you are using FXT files created by Tickstory with the Tick Data Suite. The StrategyQuant Tick Data Downloader is an application that automates tick data downloading and CSV creation. It’s free and very easy to use. By means of JForex, the Dukascopy client. Please see the Downloading Dukascopy tick data with the JForex client guide for more details. Using my PHP script collection. See the Downloading and parsing the Dukascopy tick data with Birt’s PHP scripts guide.
Warning: this is for the tech-savvy people that like to be in full control of the tick data process.
No matter which method you use, please take the time to read the “Purpose” and “No warranty by Dukascopy” sections on the Dukascopy tick data page.
Pros & cons.
– multiple download methods.
– extensive time interval coverage.
– wide array of available pairs, CFDs and indices.
– very good quality.
– up to November 2010, the data was not top-of-the-order-book, but rather aggregated in 0.5 pip increments.
– the data for some pairs (minors & metals) doesn’t go as far back as 2003.
Pepperstone and Integral.
Background.
Pepperstone is an ECN broker founded in 2010, with a solid reputation and a growing client base. I never had an account with them, but I heard good things from many people that have one and I have yet to hear from an unsatisfied client. The tick data they are offering is gathered by their partner Integral, one of the leading liquidity providers. Their data is of high quality, with spreads generally lower than Dukascopy.
The oldest data available is from 2009 and the available range of currency pairs is mostly limited to the majors (there are not many minor currency pairs and no metals). The data does not include the volume.
Available currency pairs:
The data can be downloaded at the Pepperstone tick data page or at the TrueFX downloads page, with the latter requiring registration (which is free).
The data is split in files that span one month. To use it, go through the following steps:
Download the months of interest (should be consecutive). Unpack all the zip files. Concatenate the files in order . The easiest way to do that is: Fire up a command prompt (Start->Run->cmd. exe) Change the directory to where you unpacked the files into (e. g. cd "\Documents and Settings\Administrator\My Documents\Downloads\" ) Use the type command (e. g. type EURUSD-2011-01.csv EURUSD-2011-02.csv EURUSD-2011-03.csv EURUSD-2011-04.csv > EURUSD. csv )
If you need more detailed instructions for concatenating files, please use a search engine. As a side note, if you’re using Firefox you might want to get the DownThemAll addon – it can download all the data for the pair(s) you want without too much clicking.
Pros & cons.
– very good quality.
– the first available date is 2009.
– the data is split into months and the files have to be downloaded individually and manually concatenated (merged)
– the pair name is included for every tick which is a complete waste of space and bandwidth.
MB Trading.
Background.
Another US-based broker, MB Trading provides a wide array of products; when it comes to Forex, ECN services are offered to their clients. Together with the Desktop Pro proprietary trading platform, Metatrader 4 is available but with a lot of peculiarities such as a 10k lotsize, the requirement for a special authentication key, lots of partial fills, no expiration on orders and a daily server restart that takes some 5 minutes at 5 PM US EST. These things aside, their spreads are very good and the commissions are decent as well.
The tick data offered is top-of-the-order-book without volume and it is available for a lot of pairs: the selection box includes all majors and some minors, their count almost rivaling the number of pairs available at Dukascopy. The data is completely free, but unless you already have an account with MB Trading, you are going to have to sign up for a demo account (which is of course also free). The earliest available date is January 2011.
Available currency pairs:
Head to the MB Trading tick history download page. Log in using your account credentials (if you don’t have an account, just open a demo account, it’s free). If you got lost in the registration process, once you log in to your account, the page can be accessed by clicking the Tick history link in the Tools menu.
Once you get to the actual download page, you will have to select the currency pair of your choice then start browsing and enabling each day that you want to download. Note: if you want to actually do something with the data, make sure you’re getting consecutive days, not one random day here and there.
When you’re done selecting each and every day that interests you (quite a lot of clicking if you want all of them), click Download and pray that it actually works. When I tried this, I ran into a nasty problem that would stop the download before it was finished and I had to download each day separately. Hopefully, it was just an issue on my end.
Assuming you did everything I suggested above, you should end up with a file named Tick. zip. You have to unpack it and inside you will find a bunch more zip archives, one for each day. You also have to unpack those and when that’s done, the last step to do before turning them into an FXT is concatenating them in order (see Pepperstone & Integral above for more info regarding the concatenation).
Pros & cons.
– very good quality.
– wide array of available pairs.
– the data is available only starting with 2011.
– the data is split into days and the files have to be unpacked and manually concatenated (merged)
– downloading the data can be a pain in the ass because you can only download at most 25 days at a time, making the whole process advance very slow.
– the pair name is included for every tick which is a complete waste of space and bandwidth.
– the download process is quite unfriendly.
– concatenating the files for each day can be quite a pain in the ass if you’re doing it for a time period spanning several months.
HistData.
Background.
A project by a group of traders that are making the data available for free at their own expense – an initiative that I applaud, there’s no hidden interest whatsoever.
The availability date varies by symbol and goes as far back as 2000 for some majors. However, the data is not very consistent – I downloaded two samples of EURUSD tick data, one from March 2011 and one from January 2012 (the reason being that I needed to figure out the GMT & DST); as it turns out, the March 2011 file has quotes from a market maker broker with 4 digits and a fixed EURUSD spread of 3 pips with a GMT offset of 4 (I think), while the January 2012 file has quotes from what appears to be an ECN broker (possibly MB Trading) with a GMT offset of -5. As such, the CSV2FXT script will prompt you to enter the GMT and DST offset manually.
As a nice bonus feature, the archives include text files that specify all gaps larger than 60 seconds.
Available currency pairs:
Head to the HistData and start downloading. Make sure you’re getting the Generic ASCII tick data. You can even do it via FTP if that’s more comfortable for you.
If you wish to use several of the downloaded files in your CSV, you have to unpack and concatenate them in order (see Pepperstone & Integral above for more info regarding the concatenation).
Pros & cons.
– very wide array of available symbols.
– good date availability range for many symbols.
– the data source is inconsistent (4 digit, fixed spread MM mixed with ECN)
– cumbersome download process, you have to download one month at a time, go back, download another month; paid FTP access is available, though.
– the GMT offset is inconsistent (and perhaps the DST as well)
Gain Capital aka forex.
Background.
Gain Capital is a rather old (founded in 1999) market maker broker that managed to get somewhat of a bad reputation. They hit their head on a half a mil fine that was graciously awarded to them in the year of our lord 2010 by the NFA for bad some bad practices, and I quote: “…engaged in abusive margin, liquidation and price slippage practices that benefited Gain to the detriment of its customers”. Anyway, I’m not pitying them since their forex domain name rod must be bringing them a ton of unsuspecting fish anyway.
Aside from offering shady trading conditions, they are also offering a selection of tick data, but last time I checked, its quality was just as poor. I can’t seem to remember what’s the first year that has tick data available and I can’t be bothered to download it again and find it out. Once more, fair warning: the data quality is pretty bad – not only is the data missing large chunks of time, but it’s also sporting misaligned periods (e. g. you can sometimes find data from the previous week in the file for the current week). The only good thing about it is the fact that a lot of symbols are available: from currency pairs major, minor and exotic to metals and various stocks and indices.
Available currency pairs:
If despite my warnings above you’re feeling a bit masochistic and want to play with it, you can head out to the Gain Capital rate data page and fetch the archives; I recommend using a download manager.
Before finding other tick data sources, I used to use this data for testing so I perfected some scripts for it, which are still available for download as a PHP script collection on the tick data downloads page in the Miscellaneous section.
Inside you will find:
A script to process the data into a CSV. This script is heavily based on the original by carloss from the indo-investasi forum. A script to somewhat filter & sort the resulted CSV.
Since these are totally obsolete to me, I’m not going to provide more details and you’re going to have to figure out how they work on your own. Shouldn’t be too hard, though. Please note that I’m not volunteering any support for these scripts.
Pros & cons.
– extensive array of available symbols including stocks & indices.
– the download process is cumbersome.
– the data is split into weeks and the files have to be unpacked and manually concatenated (merged)
– the data quality is poor, there are gaps and misalignments.
– there are no up to date tools to process the data.
HistData.
Free Forex Historical Data.
Download Free Forex Data.
Download Step 1: Please, select the Application/Platform and TimeFrame!
In this section you'll be able to select for which platform you'll need the data.
MetaTrader 4 / MetaTrader 5.
This platform allows the usage of M1 (1 Minute Bar) Data only.
These files are well suited for backtesting trading strategies under MetaTrader 4 and MetaTrader 5 platform. Please, select:
For generic use, this format allows importing M1 (1 Minute Bar) Data into any 3rd application. Please, select:
For this file format we'll have M1 (1 Minute Bar) Data only.
These files are well suited for calculations and random backtests to be used with Microsoft Excel.
This platform allows the usage of both M1 (1 Minute Bar) Data and Tick data with 1 second resolution.
These files are well suited for backtesting trading strategies under th most recent versions of NinjaTrader platform. Please, select the data timeframe you'll need:
This platform allows the usage of M1 (1 Minute Bar) Data only.
These files are well suited for backtesting trading strategies under MetaStock platform.
Комментариев нет:
Отправить комментарий