Pandas parse non-english string dates

by

There is a module named dateparser that is capable of handling numerous languages including french, russian, spanish, dutch and over 20 more. It also can recognize stuff like time zone abbreviations, etc.

Let’s confirm it works for a single date:

In [1]: import dateparser
        dateparser.parse('11 Janvier 2016 à 10:50')
Out[1]: datetime.datetime(2016, 1, 11, 10, 50)

Moving on to parsing this test_dates.csv file:

               Date  Value
0    7 janvier 1983     10
1  21 décembre 1986     21
2    1 janvier 2016     12

You can actually use dateparser.parse as the parser:

In [2]: df = pd.read_csv('test_dates.csv',
                         parse_dates=['Date'], date_parser=dateparser.parse)
        print(df)

Out [2]:
        Date  Value
0 1983-01-07     10
1 1986-12-21     21
2 2016-01-01     12

Obviously if you need to do that after having already loaded the dataframe, you can always use apply, or map:

# Using apply (6.22 ms per loop)
df.Date = df.Date.apply(lambda x: dateparser.parse(x))

# Or map which is slightly slower (7.75 ms per loop)
df.Date = df.Date.map(dateparser.parse)

More Related Contents:

  1. Filtering Pandas DataFrames on dates
  2. Keep only date part when using pandas.to_datetime
  3. Convert pandas timezone-aware DateTimeIndex to naive timestamp, but in certain timezone
  4. How to print pandas DataFrame without index
  5. Convert Excel style date with pandas
  6. datetime dtypes in pandas read_csv
  7. How to convert string to datetime format in pandas python?
  8. pandas dataframe groupby datetime month
  9. How to convert columns into one datetime column in pandas?
  10. Find the end of the month of a Pandas DataFrame Series
  11. Create a day-of-week column in a Pandas dataframe using Python
  12. Pandas: Subtracting two date columns and the result being an integer
  13. How to change the datetime tick label frequency for matplotlib plots
  14. Splitting timestamp column into separate date and time columns
  15. Pandas: Datetime Improperly selecting day as month from date [duplicate]
  16. Pandas converting row with unix timestamp (in milliseconds) to datetime
  17. Python pandas convert datetime to timestamp effectively through dt accessor
  18. Specifying date format when converting with pandas.to_datetime
  19. Which is the fastest way to extract day, month and year from a given date?
  20. In Pandas how do I convert a string of date strings to datetime objects and put them in a DataFrame?
  21. Locate first and last non NaN values in a Pandas DataFrame
  22. Pandas custom function to find whether it is the 1st, 2nd etc Monday, Tuesday, etc – all suggestions welcome
  23. Convert a column of timestamps into periods in pandas
  24. Clean way to convert quarterly periods to datetime in pandas
  25. Average time for datetime list
  26. Python: Adding hours to pandas timestamp
  27. how to specify the datetime format in read_csv
  28. pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  29. Python Pandas : pandas.to_datetime() is switching day & month when day is less than 13
  30. Python generating a list of dates between two dates

Leave a Comment