pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

Hi

I am running pyspark code and it was running fine yesterday. Now its giving the error:

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

How to resolve this?

Here is the full error log:

java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:524oorg.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58un.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:247)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:236)
at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:80)
at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:69)
at py4j.GatewayConnection.run(GatewayConnection.java:214)
at java.lang.Thread.run(Thread.java:748)

What is solution?

Thanks

View Answers

December 27, 2018 at 12:58 AM

Hi,

This error comes when your Spark master and other nodes are not accessible due to some reason.

I re-started spark cluster and it solved.

Thanks









Related Tutorials/Questions & Answers:
pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext
pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext  Hi I am running pyspark code and it was running fine yesterday. Now its giving the error: pyspark : An error occurred while calling
Java error reached end of file while parsing
Java error reached end of file while parsing... of file while parsing  occurred when a programmer do not close the class ... an error i.e java error reached end of file while parsing as the class closing braces
Advertisements
Error in calling javascript function from java
Error in calling javascript function from java  I am callin javascriot function from applet and getting error netscape.javascript.JSException: Unexpected error: This method should not be used unless loaded from plugin.jar
error while compiling - Java Beginners
error while compiling  i am facing problem with compiling and running a simple java program, can any one help me, the error i am getting is javac is not recognised as internal or external command  Check if you JAVA_HOME
Error While Compiling - Java Beginners
Error While Compiling  Hi All I Am a beginner and i face the following problem while compiling can anyone help me. C:\javatutorial\example> javac HelloWorld.java 'javac' is not recognized as an internal or external
getting error while inserting values in database
) { out.println("An Error Had occurred while accessing the database...getting error while inserting values in database  AddUser.java..."); if (envContext == null)throw new Exception("Error: No Context
i got an error while compile this program manually.
i got an error while compile this program manually.  import javax.servlet.http.*; import org.apache.struts.action.*; public class ActionOne{ public...,struts jar files and i got an error in saveErrors() error Heading cannot find
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
error while running a jsp page in netbeans
error while running a jsp page in netbeans  this is error that come under column "java db processes" in netbeans Exception in thread "main" java.lang.ExceptionInInitializerError
error while running the applet - Java Beginners
error while running the applet  import java.applet.Applet; import java.awt.*; import java.awt.event.*; class MyFrame extends Frame { boolean...); ++num; } } } } i have problem while running the code , error
Im getting this error while running JPA project
Im getting this error while running JPA project  Exception in thread "main" javax.persistence.PersistenceException: [PersistenceUnit: examplePersistenceUnit] Unable to configure EntityManagerFactory
error while inserting millions of records - EJB
error while inserting millions of records  Hello, I am using ejb cmp... e.printStackTrace(); } }   The following error is occur java.rmi.ServerError: Unexpected Error; nested exception
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new to maven... I created java spring hibernate project.. and i kept all .java files... on the index page it shows 500 error.. My pOM.xml is 4.0.0
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new... any link on the index page it shows 500 error.. My pOM.xml is <project...; </build> </project> But after deploying that i got this error
cannot find java.exe error while opening netbean5.5 - IDE Questions
cannot find java.exe error while opening netbean5.5  HI, 1)i am... this problem? 2)while i am installing nokiamobiletoolkit, I got the error name is windows 3 occured while loading the java vm(launching error anywhere), How can i
i have got error while compiling simple tag handler
i have got error while compiling simple tag handler   javac.servlet.jsp not found! tell me what are the jar files required to run simple tag handler...;it is : javax.servlet.jsp only but getting error wt is reason
error of HTTP Status 404 while running servlet on apache tomcat server
error of HTTP Status 404 while running servlet on apache tomcat server  i have followed the steps given here.Also hava put servlet-api in lib folder and have set classpath properly. on typing "http://localhost:8080" i do get
I had this error while deploying a web services in jboss
I had this error while deploying a web services in jboss  Error configuring application listener of class com.sun.xml.ws.transport.http.servlet.WSServletContextListener: java.lang.ClassNotFoundException
SHOWING ERROR CODE 1064 WHILE TRYING TO EXECUTE PROCEDURE
SHOWING ERROR CODE 1064 WHILE TRYING TO EXECUTE PROCEDURE  I AM... AM ALSO PUTTING THE GENERATED ERROR. (0 row(s)affected) (0 ms taken) (0 row(s)affected) (0 ms taken) Error Code : 1064 You have an error in your SQL syntax
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
Java error java.lang.nullpointerexception
Java error java.lang.nullpointerexception  ...; is the exception that occurred when a programmer perform an operation on a object  or calling a method on the object i.e null. This exception is thrown
error
error  When I deploye the example I have this message cannot Deploy HelloWorld Deployment Error for module: HelloWorld: Error occurred during deployment: Exception while deploying the app [HelloWorld
Java error class
the error occurred in the try block. These error occurred due to abnormal condition... and the message to be appear what the error occurred. Let us understand a condition... is you need to show the error message that occurred in your code.ADS
JSF error
JSF error  some of the users are not able to update the db. getting the error "An Error Occurred: Error calling action method of component with id CreateorManageOffer:jidjsp134312524923 Caused by: java.lang.NullPointerException
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
error
error  while iam compiling iam getting expected error
Java error class interface or enum excepted
Java error class interface or enum excepted       Java Error class interface or enum excepted are the class of java error that occurred when a programmer
Calling a function
Calling a function  Hi, I have a function xyz() in php code. When a button is clicked it should execute that particular function for that i have written as <form action="<?=$_SERVER['PHP_SELF'];?>" method="post">
Calling Destructor
Calling Destructor  How can i call destructor in java using System.gc() or manually. Please anyone give me a example program   Java is a garbage collected language therefore you cannot predict when (or even
Java error cannot find symbol
,the programmer write variable e,The catch block helps you in handling the error occurred... Java error cannot find symbol       The java error cannot find symbol
Java error identifier excepted
Java error identifier excepted       Java Error Identifier excepted occurred... that help you in understanding the Java error identifier excepted. For this we
Java error illegal start of type
Java error illegal start of type       The Java error illegal start of type occurred in your code when the starting braces of catch block  is not used
Java error reading from file
Java error reading from file       Java error reading file are the common error occurred  in java that when the user encounter a corrupt file
calling servlet from jsp in netbeans ide
calling servlet from jsp in netbeans ide  I have tried to call servlet from jsp code in netbeans for checking the database values . but while running it showing the error that the resource not available. i dono wat mistake i did
Java error incompatible types
Java error incompatible types       Java Error incompatible types occurred when... we want to describe you a code that help you in understanding the java error
while and do while
while and do while  hello, What is the difference between a while statement and a do statement?   hello,ADS_TO_REPLACE_1 A while statement checks at the beginning of a loop to see whether the next loop iteration
calling servlet from jsp
calling servlet from jsp  how to call a servlet from jsp
Error-
Error-   Hello, I would like to know about XSD file. I try to print XML file but I am getting error SAXException-- says Content is not allowed in prolog. Please help me
error
error  i have 404 error in my program plz tell me yhe solution about
error
error  i have 404 error in my program plz tell me yhe solution about
error
/ServletUserEnquiryForm.shtml getting an error given below SQLException caught: [Microsoft][ODBC SQL Server Driver]COUNT field incorrect or syntax error please suggest
Error
Error  I have created ajax with php for state and city. When I change state then city will not come in dropdown list and it give me error as 'Unknown Runtime Error'. This error come only in IE browser, but in other brower
calling a java file in java
calling a java file in java  how to call a another java file in java
php calling variables
php calling variables  Can i call a member variable of a class using static method in php

Ads