Error Running App containing pandas_datareader

[ronaldoussoren]

Original report by ThatBlokeDave (Bitbucket: ThatBlokeDave, ).

---

I get an error when it tries to import Pandas Error. I narrowed it down to my imports of either

#!python

import pandas_datareader as pd_dr
import pandas_datareader.data as web

When running the app I can see the following error in the terminal.

#!bash

/data-downloader.app/Contents/Resources/__boot__.py", line 107, in _run
    exec(compile(source, script, 'exec'), globals(), globals())
  File "/Users/dave/Google Drive/Development/Python/Python3/data-downloader/data-downloader.py", line 16, in <module>
    import pandas_datareader as pd_dr
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pandas_datareader/__init__.py", line 3, in <module>
    from .data import (get_components_yahoo, get_data_famafrench, get_data_google, get_data_yahoo, get_data_enigma,  # noqa
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pandas_datareader/data.py", line 7, in <module>
    from pandas_datareader.google.daily import GoogleDailyReader
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pandas_datareader/google/daily.py", line 1, in <module>
    from pandas_datareader.base import _DailyBaseReader
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pandas_datareader/base.py", line 13, in <module>
    from pandas_datareader._utils import (RemoteDataError, SymbolWarning,
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/pandas_datareader/_utils.py", line 5, in <module>
    from pandas.core.common import PandasError
ImportError: cannot import name 'PandasError'
2017-05-08 14:03:35.034 data-downloader[21603:11584460] data-downloader Error

Do I need to include something additional in the py2app or py2applet options? I saw there are some options that deal specifically deal with Matplotlib but didn't notice anything panda's related.

I am running the following packages.

py2app (0.13)
pandas (0.20.1)
pandas-datareader (0.3.0.post0)

Any pointers would be great. Apologies in advance if I have missed something obvious.

[ronaldoussoren]

Original comment by Ronald Oussoren (Bitbucket: ronaldoussoren, GitHub: ronaldoussoren).

---

you could try adding "--packages pandas,pandas_datareader" to the invocation of py2app, that tells py2app to include all of pandas in the application bundle.

I'll have to investigate further to understand why py2app doesn't automatically include required code to the application. In general this happens when code performs imports without using an import statement (either by importing from a C extension, or by using the __import__ function)

[ronaldoussoren]

Original comment by ThatBlokeDave (Bitbucket: ThatBlokeDave, ).

---

Thanks - Yes, I am not directly importing panda.core.common in my code. I assume the pandas_datareader module is importing it.

I will give your suggestion a go.

Appreciate the help.

[ronaldoussoren]

Original comment by Ronald Oussoren (Bitbucket: ronaldoussoren, GitHub: ronaldoussoren).

---

I've done a little experiment with a virtualenv of python3.6. First install py2app (from repository, not relevant for the rest of this comment), then pandas en pandas-datareader. The list of installed packages:

altgraph (0.14)
appdirs (1.4.3)
macholib (1.8)
modulegraph (0.15)
numpy (1.12.1)
packaging (16.8)
pandas (0.20.1)
pandas-datareader (0.3.0.post0)
pip (9.0.1)
py2app (0.14, /Users/ronald/Projects/py2app)
pyparsing (2.2.0)
python-dateutil (2.6.0)
pytz (2017.2)
requests (2.14.2)
requests-file (1.4.2)
requests-ftp (0.3.1)
setuptools (35.0.2)
six (1.10.0)
wheel (0.29.0)

When I use this python installation:

Python 3.6.1 (v3.6.1:69c0db5050, Mar 21 2017, 01:21:04) 
[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from pandas.core.common import PandasError
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'PandasError'

As you can see I get the ImportError even when trying the import statement from your report even before trying to get py2app involved.

Interestingly this appears to be a bug in pandas, see: pydata/pandas-datareader#305 and pydata/pandas-datareader#304. The former says that Pandas 0.19 and indeed when I uninstall pandas and then install "pandas<0.20" (that is, the latest pandas version before 0.20) the import works fine.

Before I do more research:

• Does the import statement work for you when you run it manually (without using py2app)

• Does the error still happen when you install pandas 0.19 (pip uninstall pandas; pip install 'pandas<0.20')?

[ronaldoussoren]

Original comment by ThatBlokeDave (Bitbucket: ThatBlokeDave, ).

---

Thanks for looking into it...

I tried using:

python3 setup.py py2app -A --packages pandas,pandas_datareader

But am still seeing the same error

I tried to install python 0.19

Successfully installed pandas-0.19.0
Davids-MacBook-Pro:data-downloader dave$ python3 setup.py py2app -A --packages pandas,pandas_datareader

This worked! Ok - So I need to wait for those issues to be fixed in Panda's before upgrading.

Thanks a lot for the help

[ronaldoussoren]

Original comment by ThatBlokeDave (Bitbucket: ThatBlokeDave, ).

---

Closing... Pandas issue, not py2app