Replies: 1 comment
-
Attached are two output files from running the demo for Apple and Microsoft Dates of running it are AAPL: 7/10/2024, MSFT: 7/11/2024 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Before the HuggingFace demo got paused, I was able to run it a couple of times and found a bunch of problems with the results. I was hoping to run it more to get a better sample, I ran it for Apple (AAPL). Here are the results so far.
First, it misreports market cap and shares outstanding because it does not tell you its in millions, thousands etc.
Second, every time I ran it the results were different. From a research standpoint, since the results can not be replicated, then it can't be considered reliable. Third, the results (information from archived articles) is not dated nor referenced. So It's impossible to tell the quality of the information or its age used in the analysis. Some of the data sources that you cite in the article are rather dubious for their quality. So this impacts the analysis. Fourth, it seems to take headlines from articles to reach conclusions. Sometimes news article headlines are attention grabbers such as Apple's debut to equity ratio as being risky. The article may moderate its stance by considering other factors in the text of the article, but the demo does not recognize that and so reaches a poor conclusion. Fifth, sometimes it gets the financial ratio analysis completely wrong and hence reaches the wrong conclusions. Sixth depending upon what information it bases its analysis, it might suggest the stock return will be positive or negative. This obviously will confuse the anyone.
My suggestion to you is let query run a couple of times and see if you obtain the same findings.
Beta Was this translation helpful? Give feedback.
All reactions