Java compile speed vs Scala compile speed

by

There are two aspects to the (lack of) speed for the Scala compiler.

  1. Greater startup overhead

    • Scalac itself consists of a LOT of classes which have to be loaded and jit-compiled

    • Scalac has to search the classpath for all root packages and files. Depending on the size of your classpath this can take one to three extra seconds.

    Overall, expect a startup overhead of scalac of 4-8 seconds, longer if you run it the first time so disk-caches are not filled.

    Scala’s answer to startup overhead is to either use fsc or to do continuous building with sbt. IntelliJ needs to be configured to use either option, otherwise its overhead even for small files is unreasonably large.

  2. Slower compilation speed. Scalac manages about 500 up to 1000 lines/sec. Javac manages about 10 times that. There are several reasons for this.

    • Type inference is costly, in particular if it involves implicit search.

    • Scalac has to do type checking twice; once according to Scala’s rules and a second time after erasure according to Java’s rules.

    • Besides type checking there are about 15 transformation steps to go from Scala to Java, which all take time.

    • Scala typically generates many more classes per given file size than Java, in particular if functional idioms are heavily used. Bytecode generation and class writing takes time.

    On the other hand, a 1000 line Scala program might correspond to a 2-3K line Java program, so some of the slower speed when counted in lines per second has to balanced against more functionality per line.

    We are working on speed improvements (for instance by generating class files in parallel), but one cannot expect miracles on this front. Scalac will never be as fast as javac.
    I believe the solution will lie in compile servers like fsc in conjunction with good dependency analysis so that only the minimal set of files has to be recompiled. We are working on that, too.

More Related Contents:

  1. Java compile speed vs Scala compile speed
  2. How to optimize for-comprehensions and loops in Scala?
  3. Does use of final keyword in Java improve the performance?
  4. Why is creating a Thread said to be expensive?
  5. Compiling a java program into an executable [duplicate]
  6. .toArray(new MyClass[0]) or .toArray(new MyClass[myList.size()])?
  7. Swing animation running extremely slow
  8. Compile code fully in memory with javax.tools.JavaCompiler [duplicate]
  9. System.currentTimeMillis() vs. new Date() vs. Calendar.getInstance().getTime()
  10. Java: what’s the big-O time of declaring an array of size n?
  11. Performance difference between Java 8 lambdas and anonymous inner classes
  12. Speed up Spring Boot startup time
  13. Why does appending “” to a String save memory?
  14. How to compile dynamic library for a JNI application on linux?
  15. What is the time complexity of HashMap.containsKey() in java?
  16. Most efficient Java primitive collections library [closed]
  17. Know of any Java garbage collection log analysis tools? [closed]
  18. What is the fastest Java collection with the basic functionality of a Queue?
  19. How do I resolve “WILL_NOT_PERFORM” MS AD reply when trying to change password in scala w/ the unboundid LDAP SDK?
  20. Why does “split” on an empty string return a non-empty array?
  21. Casting a class to an unrelated interface
  22. On-the-fly, in-memory java code compilation for Java 5 and Java 6
  23. Is gzip format supported in Spark?
  24. Why do I get compilation error “org/codehaus/groovy/control/CompilationFailedException”?
  25. What is the quantitative overhead of making a JNI call?
  26. Java split String performances
  27. What is the Metadata GC Threshold and how do I tune it?
  28. ArrayList vs. Vectors in Java if thread safety isn’t a concern
  29. How to save models from ML Pipeline to S3 or HDFS?
  30. Is Hibernate an overkill for an Android application? [duplicate]

Leave a Comment