Do Scala Sparc RDDs allow objects with reference members -


I started the initial stages of designing an app using SPARC RDD (which I still do not understand) Is in. There will be a large number of objects in RDD, which will consist of references to a small number (100) of some large (0.5 MB) objects.

The functions that will be mapped on the RDD will call the member functions on the objects, which alternatively calls the references on the member.

Is this possible in theory?

Spark (not spark) data will normally be passed around the use of Java serialization ( Unless you configure it to use the Kyoto). I think it will work right with big objects if you are ready to adapt your data a little bit, then it may be best to use it for large invariant items.


Comments

Popular posts from this blog

apache - 504 Gateway Time-out The server didn't respond in time. How to fix it? -

c# - .net WebSocket: CloseOutputAsync vs CloseAsync -

c++ - How to properly scale qgroupbox title with stylesheet for high resolution display? -