I use a Windows 7 and have WinPython 2.7.9.2 which runs Python 2.7.9. Using Spark’s default log4j profile: org/apache/spark/log4j-defaults.propertiesĢ1/09/16 13:54:59 INFO HistoryServer: Started daemon with process name: Ģ1/09/16 13:54:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicableĢ1/09/16 13:55:00 INFO SecurityManager: Changing view acls to: sindhuĢ1/09/16 13:55:00 INFO SecurityManager: Changing modify acls to: sindhuĢ1/09/16 13:55:00 INFO SecurityManager: Changing view acls groups to:Ģ1/09/16 13:55:00 INFO SecurityManager: Changing modify acls groups to:Ģ1/09/16 13:55:00 INFO SecurityManager: SecurityManager: authentication disabled ui acls disabled users with view permissions: Set(sindhu) groups with view permissions: Set() users with modify permissions: Set(sindhu) groups with modify permissions: Set()Ģ1/09/16 13:55:00 INFO FsHistoryProvider: History server ui acls disabled users with admin permissions: groups with admin permissionsĢ1/09/16 13:55:00 INFO Utils: Successfully started service on port 18080.Ģ1/09/16 13:55:00 INFO HistoryServer: Bound HistoryServer to 0.0.0.0, and started at Įxception in thread “main” java.io.FileNotFoundException: Log directory specified does not exist: file:/tmp/spark-events Did you configure the correct one through .logDirectory?Īt .(FsHistoryProvider.scala:280)Īt .(FsHistoryProvider.scala:228)Īt .(FsHistoryProvider.scala:410)Īt .history.HistoryServer$.main(HistoryServer.scala:303)Īt .(HistoryServer.scala)Ĭaused by: java.io.FileNotFoundException: File file:/tmp/spark-events does not existĪt .precatedGetFileStatus(RawLocalFileSystem.java:611)Īt .RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)Īt .RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)Īt .FilterFileSystem.getFileStatus(FilterFileSystem.java:428)Īt .(FsHistoryProvider.scala:270)Īt .(FsHistoryProvider.I'm having problems installing the gdal library for python.

Please let me know what am i doing wrong. I have set the variables as mentioned below in nf yet im getting the exception finle not found /tmp/spark-events.

Python for windows 7