Estimate EPS and revenue data for latest quarter?

bobydesi123

#1

1/15/2014 10:05 PM

For any given stock e.g. RHT which reported earning on 12/19/13, i would like to find out
1. Actual EPS vs. street estimate
2. Actual revenue vs. the street estimate.

Is there a way to find this information. I am only interested in the past qtr only.
I may be wrong but I dont think the fidelity fundamental data provides this information.
I would not mind even a paid website.
Thanks in advance

Eugene

#2

1/16/2014 1:57 AM

If you can't find it in Fidelity's data or among our many fundamental data providers, then show us several free sources of this data on the web. If the numbers allow themselves to be extracted (from a programming standpoint), then we might look at creating a script-based solution for getting the street estimate numbers.

Cone

#3

1/16/2014 4:10 AM

When you perform your Fidelity Update, make sure to put a check next to "Fidelity Estimated Earnings Data for Securities". Then you'll be able to just drag it onto a chart from the Fidelity Data dialog ("F" icon in the chart toolbar). That will give you the EPS estimate only; you need another source for revenue estimates.

Here's how you can access the most-recent value using code:

CODE:
Please log in to see this code.

Note that EPS estimates are updated throughout the calendar quarter (i.e., often changing), but as long as you're comparing it to actual earnings, it should be valid to use for backtesting too.

bobydesi123

#4

1/16/2014 12:28 PM

Cone, Eugene
Thank you for your quick responses.
I am aware of the EPS estimate that the fidelity fundamental data provides. However, i am unable to locate the revenue estimates.
Eugene, i am trying to find a source that provides revenue estimate. Hope fully i can find it soon and will provide that source. I will also look at all the list of providers from MS123 and see if any of them can help.,

Just to make it clear, i am looking for eps/revenue estimate for the stocks whose earning had already announced. for e.g. RHT that had announced the earning on 12/19/13, i would like to know what was the street revenue estimate.

bobydesi123

#5

1/16/2014 1:06 PM

Cone, Eugene
One way I found to access the earning report is as follows:
Will following help to write script to extract the revenus/eps estimates?

I know that the RHT announced EPS on 12/19/13

Using yahoo i can search for news as follows:
http://finance.yahoo.com/q/h?s=RHT&t=2013-12-19
This will give me all the headlines for RHT on EPS dates

Eugene

#6

1/16/2014 1:58 PM

This will not get you the actual number because news headlines are unpredictable. If you want to parse news for this purpose, then we've already developed 2 news data providers (part of MS123 Fundamental/News providers extension):

Google News provider
Reuters News provider
UPDATE 09/02/2020
SeekingAlpha news provider

What I was asking for is rather a source of estimate numbers that can be looked up, not requiring semantic analysis.

bobydesi123

#7

1/17/2014 11:57 AM

1. So far i have had no luck finding a source for past revenue estimates. I guess i will have to do this manually for now.

2. Is it possible to show me a script example to extract EPS and revenue estimate for the next qtr from yahoo>Analyst+Estimates.
e.g. for ups it will be http://finance.yahoo.com/q/ae?s=UPS+Analyst+Estimates. I am interested in Avg. Estimate eps, Revenue Est Current Qtr

Eugene

#8

1/17/2014 12:55 PM

You asked about data not appearing after adding a ~~Google~~/Reuters fundamental item and since your post was edited, seems to have found the answer yourself: data has to be updated first, just like you're used to with Fidelity fundamental data.

2. Sure. Let me come up with an example.

Eugene

#9

1/17/2014 3:24 PM

There is no "Avg. Estimate eps" there but there's "Avg. Estimate Earnings Est". Similarly, "Revenue Est Current Qtr" must be "Avg. Estimate Revenue Est". Next, you asked about "revenue estimate for the next qtr" but then mentioned "Current Qtr". If the following returns an unwanted number, point me towards the right cell as there seems to be ambiguity in your request.

Prerequisites:

1. Community Components is assumed to be installed (just because code requires HtmlAgilityPack).
2. Add a reference to System.Xml in the Editor.

CODE:
Please log in to see this code.

Hope this will do.

Size:

Color:

There is no "Avg. Estimate eps" there but there's "Avg. Estimate Earnings Est". Similarly, "Revenue Est Current Qtr" must be "Avg. Estimate Revenue Est". Next, you asked about "revenue estimate for the next qtr" but then mentioned "Current Qtr". If the following returns an unwanted number, point me towards the right cell as there seems to be ambiguity in your request.

[b]Prerequisites:[/b]

1. Community Components is assumed to be installed (just because code requires HtmlAgilityPack).
2. Add a reference to [b]System.Xml[/b] in the Editor.

[code]using System;
using System.Collections.Generic;
using System.Text;
using System.Drawing;
using WealthLab;
using WealthLab.Indicators;
using System.Net;
using System.Globalization;
using HtmlAgilityPack;

namespace WealthLab.Strategies
{
	public class Estimates
	{
		private double earnings;

public double Earnings
		{
			get { return earnings;}
			set { earnings = value;}
		}
		
		private double _revenue;

public double Revenue
		{
			get { return _revenue;}
			set { _revenue = value;}
		}
	
		public Estimates(){}
		
		public Estimates(double earnings, double revenue)
		{
			Earnings = earnings;
			Revenue = revenue;
		}
	}
	
	public class MyStrategy : WealthScript
	{
		public Estimates GetEstimates(string symbol)
		{
			double earnings = -1;
			double revenue = -1;
			Estimates e = new Estimates(earnings, revenue);
			
			string URI = string.Format("http://finance.yahoo.com/q/ae?s={0}+Analyst+Estimates", symbol);
			string xpath = "//table[@class='yfnc_tableout1']//td[@class='yfnc_tabledata1'][1]";

using (WebClient client = new WebClient())
			{
				client.Headers.Add("referer", "http://finance.yahoo.com/");
				string result = string.Empty;
				try
				{
					result = client.DownloadString(URI);

HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument();
					doc.OptionFixNestedTags = true;
					doc.LoadHtml(result);
					CultureInfo c = CultureInfo.InvariantCulture;

if (doc.DocumentNode != null)
					{
						HtmlNode n = doc.DocumentNode.SelectNodes(xpath)[0];
						if (n != null)
						{
							double.TryParse(n.InnerText.Trim(), NumberStyles.Any, c, out earnings);
							n = doc.DocumentNode.SelectNodes(xpath)[5];
							if (n != null)
							{
								char[] charsToTrim = { 'B', 'M', 'K', ' ', '\''};
								if( double.TryParse(n.InnerText.Trim(charsToTrim), NumberStyles.Any, c, out revenue) )
								{
									char last = n.InnerText[n.InnerText.Length - 1];
									revenue = last == 'B' ? revenue*1000000000 :
										last == 'M' ? revenue*1000000 : last == 'K' ? revenue*1000 : Double.NaN;
									e = new Estimates(earnings,revenue);
								}								
							}
						}
					}
				}
				catch
				{
				}
			}

return e;
		}
		
		protected override void Execute()
		{
			Estimates e = GetEstimates(Bars.Symbol);
			if( e != null )
			{
				PrintDebug( "Earnings: " + e.Earnings + '\t' + "Revenue: " + e.Revenue );
			}
		}
	}
}[/code]

Hope this will do.

bobydesi123

#10

1/17/2014 3:43 PM

Eugene,
I found the source that lists the estimated eps and revenue for given stock. It happened to be of your ms123 provider.
http://www.99wallstreet.com/v2/earnings.php?symbol=rht&submit=

What i would ideally like is a script that will:

1. go through all the stocks of a selected dataset.
2. send the last estimate revenue, eps and the actual eps and revenue to a .csv file or just a debug window.
e.g. Red Hat, Inc.
ActualEPS--- estimateEPS ActRev--- estRev --------------EPS date ------priceOnEPSdate PriceafterEPSdate
0.42 -------- ---0.35 -----------397M----383.13M------------- 2013-12-19----------49.0 --------------------56.10

I know you have an extention already that displays the above information from http://www.99wallstreet.com and can write script to accomplish the above but my suggestion is a strip down version of what the ms123 extention accomplishes.

Thank you very much for your help and advice.

bobydesi123

#11

1/17/2014 4:03 PM

Sorry for the double posts.
As far as your other question for the yahoo.com data the field in questions are e.g. RHT Current Qtr.Feb 14:
EPS- Avg. Estimate 0.37
Revenue- Avg. Estimate 398.89M
Thanks.

BTW, i am really amazed at how fast you can crank out codes that will take me a good whole day!

Eugene

#12

1/17/2014 4:30 PM

QUOTE:
As far as your other question for the yahoo.com data the field in questions are e.g. RHT Current Qtr.Feb 14:
EPS- Avg. Estimate 0.37
Revenue- Avg. Estimate 398.89M

Good, so the code is correct.

Eugene

#13

7/20/2016 6:05 AM

richard1000 asked in a duplicate thread:

I am trying to scrape the yahoo finance page for analysts data (for example https://finance.yahoo.com/quote/MSFT/analysts). I am trying to scrape Earnings Estimate table, Avg. Estimate x Current Qtr. and Revenue Estimate table, Avg.Estimate x Current Qtr.

Since Yahoo changed their web page, the string variable "xpath" is wrong. What should be the correct xpath?

I copied this code from this forum while back but I can't seem to find the topic anymore.

Eugene

#14

7/20/2016 7:16 AM

Yahoo! has had a major overhaul and the code above is broken beyond repair because its scraping technique isn't handling AJAX requests the site is now firing. Simply put, it requested the raw HTML page whereas Yahoo! now pulls all the table contents with Javascript (AJAX). Let me see if I can find a workaround.

Eugene

#15

7/20/2016 8:01 AM

As I hacked my way through their AJAX calls it turned out that elegantly parsing those JSON objects (like we do in certain data providers) would get inappropriately tricky and hard to maintain in this context of a quick script-based solution. So here's a head-on approach to the problem, not too elegant but robust and very simple:

CODE:
Please log in to see this code.

Size:

Color:

As I hacked my way through their AJAX calls it turned out that elegantly parsing those JSON objects (like we do in certain data providers) would get inappropriately tricky and hard to maintain in this context of a quick script-based solution. So here's a head-on approach to the problem, not too elegant but robust and very simple:

[code]using System;
using System.Collections.Generic;
using System.Text;
using System.Drawing;
using WealthLab;
using WealthLab.Indicators;
using System.Net;
using System.IO;
using System.Globalization;
using System.Text.RegularExpressions;

namespace WealthLab.Strategies
{
	public class Estimates
	{
		private double earnings;

public double Earnings
		{
			get { return earnings;}
			set { earnings = value;}
		}
      
		private double _revenue;

public double Revenue
		{
			get { return _revenue;}
			set { _revenue = value;}
		}
   
		public Estimates(){}
      
		public Estimates(double earnings, double revenue)
		{
			Earnings = earnings;
			Revenue = revenue;
		}
	}
   
	public class MyStrategy : WealthScript
	{		
		public Estimates GetEstimates(string symbol)
		{
			string URI = string.Format("https://query1.finance.yahoo.com/v10/finance/quoteSummary/{0}?formatted=true&lang=en-US&region=US&modules=upgradeDowngradeHistory%2CrecommendationTrend%2CfinancialData%2CearningsHistory%2CearningsTrend%2CindustryTrend&corsDomain=finance.yahoo.com", symbol);
			double earnings = -1;
			double revenue = -1;
			Estimates e = new Estimates(earnings, revenue);
			
			using (WebClient client = new WebClient())
			{
				client.Headers.Add("referer", "http://finance.yahoo.com/");
				string result = string.Empty;
				try
				{
					result = client.DownloadString(URI);
					CultureInfo c = CultureInfo.InvariantCulture;

if (!string.IsNullOrEmpty(result))
					{
						string intro = "earningsEstimate\":{\"avg\":{\"raw\":";
						int go = result.IndexOf(intro) + intro.Length;
						string[] outro = Regex.Split(result.Substring(go), ",\"fmt\"");
						double.TryParse(outro[0].Trim(), NumberStyles.Any, c, out earnings);
						
						intro = "\"revenueEstimate\":{\"avg\":{\"raw\":";
						go = result.IndexOf(intro) + intro.Length;
						outro = Regex.Split(result.Substring(go), ",\"fmt\"");
						
						if( double.TryParse(outro[0].Trim(), NumberStyles.Any, c, out revenue) )
						{
							e = new Estimates(earnings,revenue);
						} 
					}
				}
				catch
				{
				}
			}

return e;
		}
      
		protected override void Execute()
		{
			Estimates e = GetEstimates(Bars.Symbol);
			if( e != null )
			{
				PrintDebug( "Earnings: " + e.Earnings + '\t' + "Revenue: " + e.Revenue );
			}
		}
	}
}[/code]

richard1000

#16

7/20/2016 2:44 PM

Very nice work Eugene. Can it be part of WL wiki techniques for future reference?

Eugene

#17

7/20/2016 3:17 PM

Glad to help.

The answer is maybe. For that it needs some enhancements (namely to cache requests on local disk and to pull in more numbers) and to prove that it's robust over time. Let's revisit it later.

richard1000

#18

3/2/2017 7:52 PM

Another web scraping request. I wish to scrape the following web site and scrape the "Free Cash Flow" (the last line) for the latest quarter.

http://www.marketwatch.com/investing/stock/aapl/financials/cash-flow/quarter#

Eugene

#19

3/2/2017 8:08 PM

1. It doesn't seem to be related to "Estimate EPS and revenue data".
2. "Free Cash Flow" is already available in YCharts data, even in its free subset. And it can be used despite the little glitch in the current build (see workaround).

richard1000

#20

3/2/2017 10:18 PM

1. Sorry, I should have started a different thread instead.

2. Yes, YCharts data has "Free Cash Flow" but with a significant delay. The delay is, of course, due to how YCharts plots fundamental data to avoid front running the earnings release date.

Eugene

#21

3/3/2017 6:28 AM

I'm not sure if MarketWatch is considerably faster than YCharts in reporting this figure, but nonetheless if you start a new thread I'll look into scraping it.