Skip to content

Instantly share code, notes, and snippets.

@zeddee
Created July 25, 2018 18:39
Show Gist options
  • Select an option

  • Save zeddee/f6b8498b79cac423642d6a544167c753 to your computer and use it in GitHub Desktop.

Select an option

Save zeddee/f6b8498b79cac423642d6a544167c753 to your computer and use it in GitHub Desktop.

How to load tsvs into pandas

Load tsvs by specifying \s+ as a separator (sep=<seperator>) value when calling `pd.read_csv'.

If your tsv contains values with spaces, then use \s\s+ instead.

import pandas as pd
w = pd.read_csv('./weather.dat',sep='\s+',index_col=0)

Outputs:

     MxT   MnT   AvT  HDDay  AvDP  ...     MxS    SkyC     MxR     MnR AvSLP
Dy                                 ...
1     88    59  74.0   53.8   0.0  ...    93.0    23.0  1004.5     NaN   NaN
2     79    63  71.0   46.5   0.0  ...    28.0  1004.5     NaN     NaN   NaN
3     77    55  66.0   39.6   0.0  ...    24.0  1016.8     NaN     NaN   NaN
4     77    59  68.0   51.1   0.0  ...    40.0  1021.1     NaN     NaN   NaN
5     90    66  78.0   68.3   0.0  ...    84.0    55.0  1014.4     NaN   NaN
6     81    61  71.0   63.7   0.0  ...    93.0    60.0  1012.7     NaN   NaN
7     73    57  65.0   53.0   0.0  ...    90.0    48.0  1021.8     NaN   NaN
8     75    54  65.0   50.0   0.0  ...    93.0    41.0  1026.3     NaN   NaN
9     86   32*  59.0    6.0  61.5  ...    78.0    46.0  1018.6     NaN   NaN
10    84    64  74.0   57.5   0.0  ...    84.0    40.0  1019.0     NaN   NaN
11    91    59  75.0   66.3   0.0  ...    93.0    45.0  1012.6     NaN   NaN
12    88    73  81.0   68.7   0.0  ...    94.0    51.0  1007.0     NaN   NaN
13    70    59  65.0   55.0   0.0  ...    83.0    59.0  1012.6     NaN   NaN
14    61    59  60.0    5.0  55.9  ...    10.0    93.0    87.0  1008.6   NaN
15    64    55  60.0    5.0  54.9  ...     9.6    96.0    70.0  1006.1   NaN
16    79    59  69.0   56.7   0.0  ...    87.0    44.0  1007.0     NaN   NaN
17    81    57  69.0   51.7   0.0  ...    90.0    34.0  1012.5     NaN   NaN
18    82    52  67.0   52.6   0.0  ...    34.0  1021.3     NaN     NaN   NaN
19    81    61  71.0   58.9   0.0  ...    87.0    44.0  1028.5     NaN   NaN
20    84    57  71.0   58.9   0.0  ...    90.0    43.0  1032.5     NaN   NaN
21    86    59  73.0   57.7   0.0  ...    87.0    35.0  1030.7     NaN   NaN
22    90    64  77.0   61.1   0.0  ...    78.0    38.0  1026.4     NaN   NaN
23    90    68  79.0   63.1   0.0  ...    68.0    42.0  1021.3     NaN   NaN
24    90    77  84.0   67.5   0.0  ...    74.0    48.0  1018.2     NaN   NaN
25    90    72  81.0   61.3   0.0  ...    29.0  1019.6     NaN     NaN   NaN
26   97*    64  81.0   70.4   0.0  ...   107.0    45.0  1014.9     NaN   NaN
27    91    72  82.0   69.7   0.0  ...    90.0    47.0  1009.0     NaN   NaN
28    84    68  76.0   65.6   0.0  ...   100.0    51.0  1011.0     NaN   NaN
29    88    66  77.0   59.7   0.0  ...    33.0  1020.6     NaN     NaN   NaN
30    90    45  68.0   63.6   0.0  ...   200.0    41.0  1022.7     NaN   NaN
mo  82.9  60.5  71.7   16.0  58.8  ...     NaN     NaN     NaN     NaN   NaN

[31 rows x 16 columns]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment