• Recent Articles

    jsiwila

    Processing Records Rejected by a Read File Operator

    This is a companion article to Processing Rejected Records. That deals with records rejected by the Read Excel operator and applies to Read operators in other expressor Extensions and to the Read Custom operator.

    Parsing records rejected by the Read File operator is simpler than parsing records from Read Excel and related operators. The Read File operator retains the sequence of fields and attributes when it writes them to the RecordData field of the Reject Record Schema. Because of that, it is not necessary for the Read File operator to write header records to describe the field and attribute sequence. That greatly simplifies the datascript required to parse the RecordData field and reconstruct the rejected records.

    As explained in the Processing Rejected Records article, when a Read operator... read more
    jsiwila 05-14-2012, 03:33 PM
    jlifter

    expressor tutorials

    In this section you will find a collection of older tutorials that demonstrate the features of expressor Studio and the entire expressor Data Integration Platform. Though... read more
    jlifter 05-08-2012, 04:08 PM
    jsiwila

    Release Notes - expressor 3.6.0, 3.6.1, 3.6.2, 3.6.3, and 3.6.4

    expressor 3.6.4 fixes four bugs, three in Studio (STU-4728, STU-4730, and STU-4744) and one having to do with reading Informix databases from dataflows running on Linux (PRO-2634). See the resolved issues section below for a description of each of the fixed bugs.

    Also, see STU-4729in the known issues section below. STU-4729 describes an issue encountered when upgrading artifacts in a Repository Workspace.

    Note that the Informix ODBC drivers shipped with expressor software do not support Unicode on Linux.

    expressor 3.6.3 fixes three bug in Studio: one covering memory leaks, another dealing with binding to the Oracle NUMBER data type, and the third corrects unnecessary rounding when converting a double precision value to decimal. See STU-4641, STU-4625, and PRO-2622 under resolved issues below. Also see STU-4657 in the known issues section immediately following for a workaround to a problem dealing with NUMBER... read more
    jsiwila 05-08-2012, 09:02 AM
    jsiwila

    Processing Rejected Records

    When records produce errors because they violate constraints set on Composite Type
    attributes or other reasons, the operator that encounters the error can handle them
    by skipping them, aborting the dataflow, or rejecting the offending records. In some
    cases, it is sufficient to simply send rejected records to a Write File operator
    and examine the records in the output file. If the intent is, however, to correct
    or otherwise use those records, examining each error and changing the data could
    be very cumbersome. The more efficient approach would be to reprocess the records
    as they come out the reject port.

    Records rejected by input operators such as Read File, Read Table, and Read Excel are structured into the following fields:

    RejectType
    RecordNumber
    RecordData
    RejectReason
    RejectMessage

    The record data as it was constituted before being rejected is contained in the RecordData field. To process that data, it must first be reconstructed from the rejected record format. Several factors affect the reconstruction. The order of the record data fields can be different from the order represented in the original Schema, and some of the records emitted from the reject port do not contain record data. For example, RejectType 1 errors are constraint violations, but before they are emitted, a RejectType 4 record is emitted. The RejectType 4 record contains the record data field order for the subsequent RejectType 1 errors in its RecordData field. The RejectTypes are fully explained in the Using the Reject Port section of the Read Custom operator topic in the product documentation.

    Note: All non-input operators that have a reject port emit rejected records with the existing attributes of the record, that is, they do not restructure the records the way input operators do. Reprocessing records rejected by non-input operators do not have to be reconstructed
    ... read more
    jsiwila 05-07-2012, 10:00 AM
  • expressor Studio 3.2 and 3.3 RSS Feed

    by Published on 07-21-2011 02:51 PM

    You may already have downloaded and installed expressor Studio. If so, you only need to carry out the last two bullets on the following list.
    ...
    by Published on 07-21-2011 01:55 PM
    Article Preview

    Every development tool presents a Hello World type application as a first example, so here goes: read a file, write a file. With expressor Studio, creating this application is quite simple; the context sensitive help will guide you through each step of the process.

    Step-by-Step Procedure

    1. Use the Windows Start menu entry to open expressor
    ...
    by Published on 07-21-2011 03:44 PM

    In Tutorial1, you developed an expressor data integration application in which all artifacts were contained within a single project. An expressor project may include many connection, schema, and dataflow ...
    by Published on 07-21-2011 03:56 PM
    Article Preview

    In the preceding tutorials, you created a schema that described the data fields in a file. In completing the example, you did not review the contents of the schema but just used it, and its encapsulated ...
    by Published on 07-21-2011 04:04 PM

    In the Schema Editor, the information displayed in the left-hand panel is derived from the data resource's metadata. For a file data resource, each field is a string so the only metadata of substance is the name of the field. The metadata that describes a database table is much richer and includes the column ...
    by Published on 07-21-2011 10:21 AM

    In the last tutorial you started to learn about expressor semantic types. You opened a delimited schema, saw how fields are mapped to attributes, created a new local composite type, and then promoted the composite type so that it became a reusable artifact. In the future, you can use ...
    by Published on 07-21-2011 11:34 AM
    Article Preview

    Now that you have a composite type that describes the contents of your modified record, and a schema that will write this record to a delimited file, you are ready to reconfigure your dataflow to carry out the transformation. ...
    by Published on 07-21-2011 10:58 AM
    Article Preview

    Now that you have some experience accessing delimited files and working with atomic and composite types, schemas, and mapping sets, it's time to turn your attention to accessing database tables. The approach is very similar to what you did with delimited files except that the connection contains significantly more ...
    by Published on 07-21-2011 04:19 PM
    Article Preview

    Now that you have the artifacts needed to access a database table, what sort of application could you develop that will illustrate database access and usage of some of the other expressor operators. After all, the objective of this tutorial is to learn about the expressor not mastery of the AdventureWorks database.

    Together the SalesOrderHeader and SalesOrderDetail tables ...
    by Published on 07-21-2011 04:44 PM
    Article Preview

    In the last two tutorials, you followed a tightly scripted development plan in designing the data integration application. You were able to create all of the required schema and type artifacts before you began creating the dataflow. And when you needed a type to configure ...
    by Published on 07-21-2011 05:58 PM

    This tutorial replicates the data integration application developed in tutorials 7, 8 and 9 using file, rather than database, input. This document ...

Gravatar as Default Avatar by 1e2.it

SEO by vBSEO 3.6.0