15.1 C
London
Friday, July 5, 2024
HomeSoftware TutorialsPythonHow to Calculate Rolling Correlation in Pandas (With Examples)

How to Calculate Rolling Correlation in Pandas (With Examples)

Related stories

Learn About Opening an Automobile Repair Shop in India

Starting a car repair shop is quite a good...

Unlocking the Power: Embracing the Benefits of Tax-Free Investing

  Unlocking the Power: Embracing the Benefits of Tax-Free Investing For...

Income Splitting in Canada for 2023

  Income Splitting in Canada for 2023 The federal government’s expanded...

Can I Deduct Home Office Expenses on my Tax Return 2023?

Can I Deduct Home Office Expenses on my Tax...

Canadian Tax – Personal Tax Deadline 2022

  Canadian Tax – Personal Tax Deadline 2022 Resources and Tools...

Rolling correlations are correlations between two time series on a rolling window. One benefit of this type of correlation is that you can visualize the correlation between two time series over time.

This tutorial explains how to calculate and visualize rolling correlations for a pandas DataFrame in Python.

How to Calculate Rolling Correlations in Pandas

Suppose we have the following data frame that display the total number of products sold for two different products (x and y) during a 15-month period:

import pandas as pd
import numpy as np

#create DataFrame
df = pd.DataFrame({'month': np.arange(1, 16),
                   'x': [13, 15, 16, 15, 17, 20, 22, 24, 25, 26, 23, 24, 23, 22, 20],
                   'y': [22, 24, 23, 27, 26, 26, 27, 30, 33, 32, 27, 25, 28, 26, 28]})

#view first six rows
df.head()

  month  x  y
1     1 13 22
2     2 15 24
3     3 16 23
4     4 15 27
5     5 17 26
6     6 20 26

To calculate a rolling correlation in pandas, we can use the rolling.corr() function.

This function uses the following syntax:

df[‘x’].rolling(width).corr(df[‘y’])

where:

  • df: Name of the data frame
  • width: Integer specifying the window width for the rolling correlation
  • x, y: The two column names to calculate the rolling correlation between

Here’s how to use this function to calculate the 3-month rolling correlation in sales between product x and product y:

#calculate 3-month rolling correlation between sales for x and y
df['x'].rolling(3).corr(df['y'])

0          NaN
1          NaN
2     0.654654
3    -0.693375
4    -0.240192
5    -0.802955
6     0.802955
7     0.960769
8     0.981981
9     0.654654
10    0.882498
11    0.817057
12   -0.944911
13   -0.327327
14   -0.188982
dtype: float64

This function returns the correlation between the two product sales for the previous 3 months. For example:

  • The correlation in sales during months 1 through 3 was 0.654654.
  • The correlation in sales during months 2 through 4 was -0.693375.
  • The correlation in sales during months 3 through 5 was -0.240192.

And so on.

We can easily adjust this formula to calculate the rolling correlation for a different time period. For example, the following code shows how to calculate the 6-month rolling correlation in sales between the two products:

#calculate 6-month rolling correlation between sales for x and y
df['x'].rolling(6).corr(df['y']) 
0          NaN
1          NaN
2          NaN
3          NaN
4          NaN
5     0.558742
6     0.485855
7     0.693103
8     0.756476
9     0.895929
10    0.906772
11    0.715542
12    0.717374
13    0.768447
14    0.454148
dtype: float64

This function returns the correlation between the two product sales for the previous 6 months. For example:

  • The correlation in sales during months 1 through 6 was 0.558742.
  • The correlation in sales during months 2 through 7 was 0.485855.
  • The correlation in sales during months 3 through 8 was 0.693103.

And so on.

Notes

Here are a few notes for the functions used in these examples:

  • The width (i.e. the rolling window) should be 3 or greater in order to calculate correlations.
  • You can find the full documentation for the rolling.corr() function here.

Additional Resources

How to Calculate Rolling Correlation in R
How to Calculate Rolling Correlation in Excel

Subscribe

- Never miss a story with notifications

- Gain full access to our premium content

- Browse free from up to 5 devices at once

Latest stories