Releases: blaze/blaze
version 0.11.0
Release 0.11.0
:Release: 0.11.0
New Expressions
* Many new string utility expressions were added that follow the Pandas
vectorized string methods API closely
`<http://pandas.pydata.org/pandas-docs/stable/text.html#text-string-methods>`_.
These are gathered under the ``.str`` sub-namespace, allowing the user to
say::
t.col.str.lower()
to compute a new column with the string contents lowercased.
* Likewise, many new datetime utility expressions were added to the ``.dt``
sub-namespace, following Pandas vectorized datetime methods API
`<http://pandas.pydata.org/pandas-docs/stable/timeseries.html>`_.
Improved Expressions
None
New Backends
None
Improved Backends
None
Experimental Features
None
API Changes
-
The following functions were deprecated in favor of equivalent functions
without thestr_name prefix:====================================== ===================================
deprecated function replacement function
====================================== ===================================
:func:~blaze.expr.strings.str_len:func:~blaze.expr.strings.len
:func:~blaze.expr.strings.str_upper:func:~blaze.expr.strings.upper
:func:~blaze.expr.strings.str_lower:func:~blaze.expr.strings.lower
:func:~blaze.expr.strings.str_cat:func:~blaze.expr.strings.cat
====================================== ===================================
Bug Fixes
None
Miscellaneous
None
Version 0.10.1
New Expressions
None
Improved Expressions
None
New Backends
None
Improved Backends
- Blaze server's
/addendpoint was enhanced to take a more general payload
(:issue:1481). - Adds consistency check to blaze server at startup for YAML file and dynamic
addition options (:issue:1491).
Experimental Features
- The
str_cat()expression was added, mirroring Pandas'
Series.str.cat()API (:issue:1496).
API Changes
None
Bug Fixes
- The content type specification parsing was improved to accept more elaborate
headers (:issue:1490). - The discoverablility consistency check is done before a dataset is
dynamically added to the server (:issue:1498).
Miscellaneous
None
0.10.0
Release 0.10.0
New Expressions
-
The
sampleexpression allows random sampling of rows to facilitate
interactive data exploration (:issue:1410). It is implemented for the
Pandas, Dask, SQL, and Python backends. -
Ad 10000 ds :func:
~blaze.expr.expressions.coalesceexpression which takes two
arguments and returns the first non missing value. If both are missing then
the result is missing. For example:coalesce(1, 2) == 1,
coalesce(None, 1)== 1, andcoalesce(None, None) == None.
This is inspired by the sql function of the same name (:issue:1409). -
Adds :func:
~blaze.expr.expressions.castexpression to reinterpret an
expression's dshape. This is based on C++reinterpret_cast, or just normal
C casts. For example:
symbol('s', 'int32').cast('uint32').dshape == dshape('uint32'). This
expression has no affect on the computation, it merely tells blaze to treat
the result of the expression as the new dshape. The compute definition for
castis simply:@dispatch(Cast, object)
def compute_up(expr, data, **kwargs):
return data(:issue:
1409).
Improved Expressions
- The test suite was expanded to validate proper expression input error handling
(:issue:1420). - The :func:
~blaze.expr.datetime.truncatefunction was refactored to raise an
exception for incorrect inputs, rather than using assertions (:issue:1443). - The docstring for :class:
~blaze.expr.collections.Mergewas expanded to
include examples using :class:~blaze.expr.expressions.Labelto control the
ordering of the columns in the result (:issue:1447).
Improved Backends
- Adds :class:
~blaze.expr.math.greatestand :class:~blaze.expr.math.least
support to the sql backend (:issue:1428). - Generalize
Fieldto support :class:collections.Mappingobject
(:issue:1467).
Experimental Features
- The :class:
~blaze.expr.strings.str_upperand
:class:~blaze.expr.strings.str_lowerexpressions were added for the Pandas
and SQL backends (:issue:1462). These are marked experimental since their
names are subject to change. More string methods will be added in coming
versions.
API Changes
- The :class:
~blaze.expr.strings.strlenexpression was deprecated in favor of
:class:~blaze.expr.strings.str_len(:issue:1462). - Long deprecated :func:
~blaze.table.Tableand
:func:~blaze.table.TableSymbolwere removed (:issue:1441). The
TableSymboltests intest_table.pywere migrated to
test_symbol.py. - :func:
~blaze.interactive.Datahas been deprecated in favor of
:func:~blaze.interactive.data. :class:~blaze.interactive.InteractiveSymbol
has been deprecated and temporarily replaced by
:class:~blaze.interactive._Data. These deprecations will be in place for
the 0.10 release. In the 0.11 release, :class:~blaze.interactive._Data
will be renamed toData, calls to :func:~blaze.interactive.datawill
createDatainstances, and :class:~blaze.interactive.InteractiveSymbol
will be removed (:issue:1431and :issue:1421). - :func:
~blaze.compute.core.computehas a new keyword argument
return_typewhich defaults to'native'(:issue:1401, :issue:1411,
:issue:1417), which preserves existing behavior. In the 0.11 release,
return_typewill be changed to default to'core', which will
odonon-core backends into core backends as the final step in a call to
compute. - Due to API instability and on the recommendation of DyND developers, we
removed the DyND dependency temporarily (:issue:1379). When DyND achieves
its 1.0 release, DyND will be re-incorporated into Blaze. The existing DyND
support in Blaze was rudimentary and based on an egregiously outdated and
buggy version of DyND. We are aware of no actual use of DyND via Blaze in
practice. - The :class:
~blaze.expr.expressions.Expr__repr__method's triggering of
implicit computation has been deprecated. Using this aspect of Blaze will
trigger aDeprecationWarningin version 0.10, and this behavior will be
replaced by a standard (boring)__repr__implementation in version 0.11.
Users can explicitly trigger a computation to see a quick view of the results
of an interactive expression by means of the
:func:~blaze.expr.expressions.Expr.peekmethod. By setting the
:mod:~blaze.interactive.use_new_reprflag toTrue, users can use the
new (boring)__repr__implementation in version 0.10 (:issue:1414
and :issue:1395).
Bug Fixes
- The :class:
~blaze.expr.strings.str_upperand
:class:~blaze.expr.strings.str_lowerschemas were fixed to pass through
their underlying_child's schema to ensure option types are handled
correctly (:issue:1472). - Fixed a bug with Pandas' implementation of
compute_upon
:class:~blaze.expr.broadcast.Broadcastexpressions (:issue:1442). Added
tests for Pandas frame and series and dask dataframes onBroadcast
expressions. - Fixed a bug with :class:
~blaze.expr.collections.Sampleon SQL backends
(:issue:1452:issue:1423:issue:1424:issue:1425). - Fixed several bugs relating to adding new datasets to blaze server instances
(:issue:1459). Blaze server will make a best effort to ensure that the
added dataset is valid and loadable; if not, it will return appropriate HTTP
status codes.
Miscellaneous
- Adds logging to server compute endpoint. Includes expression being computed
and total time to compute. (:issue:1436) - Merged the
coreandallconda recipes (:issue:1451). This
simplifies the build process and makes it consistent with the single
blazepackage provided by the Anaconda distribution. - Adds a
--yaml-diroption toblaze-serverto indicate the server
should load path-basedyamlresources relative to the yaml file's
d
0.8.3
0.8.2
0.8.1
0.8.0
Major release
features
- improved sql support
IsInexpression with pandas semantics- sql backend has multicolumn sort
- group by dates in sql
- sql backend doesn't generate nested queries when combining transforms, selections and
Byexpressions - spark dataframes now join in sparksql land rather than joining as RDDs
- mongo databases are now first class citizens
- support for pymongo 3.0
- start a dask backend
bug fixes
char_lengthfor sql string length rather thanlength, which counts bytes not characters- deterministic ordering for columns in a
Mergeexpression - put a lock around numba ufunc generation
- Fix variability functions on sql databases #1051
0.7.3
0.7.2
0.7.1
Version 0.7.1
- Better array support to align numpy with dask (dot, transpose, slicing)
- Support
__array__, __iter__, __int__, ...protocols - Numba integration with numpy layer
- Server works on raw datasets, not dicts. Also, support dicts as datasets.
- SQL
- Avoid repeated reflection
- Support computation on metadata instances. Support schemas.
- CachedDataset
- pandas.HDFStore support
- Support NumPy promotion rules