Pystagegate Demos

Pystagegate Demos#

Executable notebook demonstrating code usage

Notebook kernel setup

import os
from pystagegate.pipelines import prov_fin_main

os.chdir("..")

Run the prov_fin pipeline

prov_fin_output = prov_fin_main("tests/data/testing_config.json")
prov_fin_output.head(10)
Local Authority Code imm_prov em_prov net_prov sqdiff_imm sqdiff_em sqdiff_net sqdiff_imm_sc sqdiff_em_sc sqdiff_net_sc nation
0 E1 3460.000000 1725.000000 1048.000000 735.444087 16149.401934 10646.207181 0.212556 9.361972 3.076938 E
1 E2 5337.000000 2361.000000 1662.000000 4766.374981 1574.825572 3972.412107 0.893081 0.667016 0.744316 E
2 E3 5843.000000 2452.000000 2449.000000 8473.822842 9637.365020 9040.340652 1.450252 3.930410 1.547209 E
3 E4 2987.000000 1208.000000 1219.000000 740.231523 461.521105 3005.555541 0.247818 0.382054 1.006212 E
4 W1 5566.000000 2245.000000 2211.000000 25339.327641 3450.461540 7652.023702 4.552520 1.536954 1.374780 W
5 W2 6326.000000 2681.000000 2654.000000 25339.327641 3450.461540 7652.023702 4.005585 1.287005 1.209615 W
6 S1 162.563319 8.106520 154.456799 178.973390 25.739360 52202.592971 1.100946 3.175143 321.121599 S
7 S2 394.860343 720.516491 -325.656148 51.991725 48.086456 57337.072709 0.131671 0.066739 145.208486 S
8 S3 734.577052 613.514938 121.062115 140.250034 73.825815 5142.259935 0.190926 0.120333 7.000300 S

Further data analysis with prov_fin_output DataFrame

prov_fin_output.groupby("nation")[["sqdiff_imm_sc", "imm_prov"]].corr()
sqdiff_imm_sc imm_prov
nation
E sqdiff_imm_sc 1.000000 0.956829
imm_prov 0.956829 1.000000
S sqdiff_imm_sc 1.000000 -0.773687
imm_prov -0.773687 1.000000
W sqdiff_imm_sc 1.000000 -1.000000
imm_prov -1.000000 1.000000