MSR Action Recognition Datasets and Code:

https://sites.google.com/view/wanqingli/home-news

look for drop-down menu item "data sets"