How two read SAS data with PySpark

For some reason, I have to convert sas data to hdfs then analyse with  pyspark. after some research I found spark-sas7bdat is the best solution for me. This package allows reading SAS files in local or distributed filesystem as Spark DataFrames. Schema is automatically inferred from meta information embedded in the …

Python For SAS Users

I am a coder, and focus on machine learning now. for some reason, I learned SAS 2 years ago, for a coder,  SAS language is very strange, but I had to learn it. when I am familiar with it, I have to learn Python now. So I collect some useful …

How to set virtualenv for a crontab?

Recent I was asked  to batch run Python script in a virtualenv and also run in crontab. for example,  pyspark_hello_world.py

I …