Pystagegate Demos#
Executable notebook demonstrating code usage
Notebook kernel setup
import os
from pystagegate.pipelines import prov_fin_main
os.chdir("..")
Run the prov_fin pipeline
prov_fin_output = prov_fin_main("tests/data/testing_config.json")
prov_fin_output.head(10)
| Local Authority Code | imm_prov | em_prov | net_prov | sqdiff_imm | sqdiff_em | sqdiff_net | sqdiff_imm_sc | sqdiff_em_sc | sqdiff_net_sc | nation | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | E1 | 3460.000000 | 1725.000000 | 1048.000000 | 735.444087 | 16149.401934 | 10646.207181 | 0.212556 | 9.361972 | 3.076938 | E |
| 1 | E2 | 5337.000000 | 2361.000000 | 1662.000000 | 4766.374981 | 1574.825572 | 3972.412107 | 0.893081 | 0.667016 | 0.744316 | E |
| 2 | E3 | 5843.000000 | 2452.000000 | 2449.000000 | 8473.822842 | 9637.365020 | 9040.340652 | 1.450252 | 3.930410 | 1.547209 | E |
| 3 | E4 | 2987.000000 | 1208.000000 | 1219.000000 | 740.231523 | 461.521105 | 3005.555541 | 0.247818 | 0.382054 | 1.006212 | E |
| 4 | W1 | 5566.000000 | 2245.000000 | 2211.000000 | 25339.327641 | 3450.461540 | 7652.023702 | 4.552520 | 1.536954 | 1.374780 | W |
| 5 | W2 | 6326.000000 | 2681.000000 | 2654.000000 | 25339.327641 | 3450.461540 | 7652.023702 | 4.005585 | 1.287005 | 1.209615 | W |
| 6 | S1 | 162.563319 | 8.106520 | 154.456799 | 178.973390 | 25.739360 | 52202.592971 | 1.100946 | 3.175143 | 321.121599 | S |
| 7 | S2 | 394.860343 | 720.516491 | -325.656148 | 51.991725 | 48.086456 | 57337.072709 | 0.131671 | 0.066739 | 145.208486 | S |
| 8 | S3 | 734.577052 | 613.514938 | 121.062115 | 140.250034 | 73.825815 | 5142.259935 | 0.190926 | 0.120333 | 7.000300 | S |
Further data analysis with prov_fin_output DataFrame
prov_fin_output.groupby("nation")[["sqdiff_imm_sc", "imm_prov"]].corr()
| sqdiff_imm_sc | imm_prov | ||
|---|---|---|---|
| nation | |||
| E | sqdiff_imm_sc | 1.000000 | 0.956829 |
| imm_prov | 0.956829 | 1.000000 | |
| S | sqdiff_imm_sc | 1.000000 | -0.773687 |
| imm_prov | -0.773687 | 1.000000 | |
| W | sqdiff_imm_sc | 1.000000 | -1.000000 |
| imm_prov | -1.000000 | 1.000000 |