khiemdoan/process_data.md

Created November 4, 2019 15:20

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/khiemdoan/11ba68fe66290999ad33e7f67760274c.js"></script>
Save khiemdoan/11ba68fe66290999ad33e7f67760274c to your computer and use it in GitHub Desktop.

Raw

    from IPython.display import display

def summary_data(data):
    print(f'Dataframe dimensions: {data.shape}')
    tab_info = pd.DataFrame(data.dtypes).T.rename(index={0: 'column type'})
    tab_info = tab_info.append(pd.DataFrame(data.isnull().sum()).T.rename(index={0: 'null values (nb)'}))
    tab_info = tab_info.append(pd.DataFrame(data.isnull().sum() / data.shape[0] * 100).T.rename(index={0: 'null values (%)'}))
    display(tab_info)

  