Difference between revisions of "New features"

From VistrailsWiki
Jump to navigation Jump to search
(Added BatchQ)
m (Add statuses)
Line 3: Line 3:
== Core ==
== Core ==


=== vistrails prefix ===
=== vistrails prefix [ready] ===
'vistrails.' prefix added to package names. Allows to use VisTrails as a library.
'vistrails.' prefix added to package names.


=== Multi-line string parameters ===
This allows to use VisTrails as a library, it obsoletes the "init_for_library.py" hack.


=== Bundles ===
=== Multi-line string parameters [ready] ===
The parameter editor allows to enter multi-line strings. It can be toggled between single-line and multi-line mode.
 
=== Bundles [needs work] ===
Fixed and updated the bundle installation system. It allows to automatically install required Python packages when they are first imported without restarting VisTrails or entering commands.
Fixed and updated the bundle installation system. It allows to automatically install required Python packages when they are first imported without restarting VisTrails or entering commands.


Supports the 'pip' installer (on both UNIX and Windows), apt (through Python binding) and Fedora (with yum -- '''binding currently broken, only uses cmd''')
Supports the 'pip' installer (on both UNIX and Windows), apt (through Python binding) and Fedora (with yum -- '''binding currently broken, only uses cmd''')


=== Automatic conversion ===
=== Automatic conversion [ready, documented] ===
Connecting incompatible ports is possible if a Converter subclass exists for these specific types.
Connecting incompatible ports is possible if a Converter subclass exists for these specific types.


Documented in the users' guide.
Documented in the users' guide.


=== Enumeration for module ports ===
=== Enumeration for module ports [ready, demonstrated for PythonCalc] ===
It is possible to declare the possible values on a module's input port; the UI then shows a combobox.
It is possible to declare the possible values on a module's input port; the UI then shows a combobox.


=== [[multithreaded-interpreter|Parallel execution]] ===
=== [[multithreaded-interpreter|Parallel execution]] [work in progress, undocumented] ===
Changes to the interpreter allowing the parallel execution of modules in a pipeline.
Changes to the interpreter allowing the parallel execution of modules in a pipeline.


Line 30: Line 33:
== Packages ==
== Packages ==


=== parallelflow ===
=== parallelflow [ready, documented] ===
Provides a way to execute modules or groups on an IPython cluster, via a Map module. Also has IPython UI to set it up, and an API to use IPython in other modules.
Provides a way to execute modules or groups on an IPython cluster, via a Map module. Also has IPython UI to set it up, and an API to use IPython in other modules.


Line 37: Line 40:
Note that it becomes obsolete with multithreaded-interpreter although a lot of code was reused.
Note that it becomes obsolete with multithreaded-interpreter although a lot of code was reused.


=== matplotlib ===
=== matplotlib [ready, examples exist] ===
Replaces pylab with a better interface (specialized modules autogenerated from matplotlib's docstrings).
Replaces pylab with a better interface (specialized modules autogenerated from matplotlib's docstrings).


Lots of examples in examples/matplotlib/
Lots of examples in examples/matplotlib/


=== tabledata ===
=== tabledata [ready] ===
A package allowing to load CSV files and NumPy arrays, to display them as a table and to convert between datatypes.
A package allowing to load CSV files and NumPy arrays, to display them as a table and to convert between datatypes.


=== BatchQ-PBS ("JobSubmission") ===
=== BatchQ-PBS ("JobSubmission") [work in progress, undocumented] ===
Task submitting package using [https://github.com/troelsfr/BatchQ BatchQ]. Work in progress, no documentation.
Task submitting package using [https://github.com/troelsfr/BatchQ BatchQ].
 
Still work in progress.

Revision as of 20:35, 19 July 2013

This is a list of work-in-progress features, or features that haven't been released in a 2.0.x version.

Core

vistrails prefix [ready]

'vistrails.' prefix added to package names.

This allows to use VisTrails as a library, it obsoletes the "init_for_library.py" hack.

Multi-line string parameters [ready]

The parameter editor allows to enter multi-line strings. It can be toggled between single-line and multi-line mode.

Bundles [needs work]

Fixed and updated the bundle installation system. It allows to automatically install required Python packages when they are first imported without restarting VisTrails or entering commands.

Supports the 'pip' installer (on both UNIX and Windows), apt (through Python binding) and Fedora (with yum -- binding currently broken, only uses cmd)

Automatic conversion [ready, documented]

Connecting incompatible ports is possible if a Converter subclass exists for these specific types.

Documented in the users' guide.

Enumeration for module ports [ready, demonstrated for PythonCalc]

It is possible to declare the possible values on a module's input port; the UI then shows a combobox.

Parallel execution [work in progress, undocumented]

Changes to the interpreter allowing the parallel execution of modules in a pipeline.

This is opt-in for modules and thus doesn't break modules that use thread-unsafe code. Supports threads, multiprocessing and IPython clusters.

Replaces parallelflow.

Packages

parallelflow [ready, documented]

Provides a way to execute modules or groups on an IPython cluster, via a Map module. Also has IPython UI to set it up, and an API to use IPython in other modules.

Documented in the users' guide. First implemented in Oct, 2012 by Fernando.

Note that it becomes obsolete with multithreaded-interpreter although a lot of code was reused.

matplotlib [ready, examples exist]

Replaces pylab with a better interface (specialized modules autogenerated from matplotlib's docstrings).

Lots of examples in examples/matplotlib/

tabledata [ready]

A package allowing to load CSV files and NumPy arrays, to display them as a table and to convert between datatypes.

BatchQ-PBS ("JobSubmission") [work in progress, undocumented]

Task submitting package using BatchQ.

Still work in progress.