So I created a complete package that contains 19 separate dataflows. I created the package in my dev environment and am now trying to create substitution files for each one to be used in my production environment. Starting on the first, I am not able to make it successfully work. I successfully created the substitution files and set the value for the two parameters I want to set. (The only things I need to change are target connection and database name. The target databases are identical in dev and prod.)

When I run the packaged dataflow via a batch file on my production server with no substitution file, everything works great. When I attach the substitution file, I get a "table not found" error. As stated, the dev and prod database are identical. See screenshot attached below...

Any ideas what setting I might be missing or what I am doing wrong???

Attached Images

• Image 233.jpg (203.2 KB)

expressor Community - reply to this thread and tell me what you would like to see as the next Video Tutorial.

In this video you will learn:

• How to use the Transform Operator to process fixed width files
• A technique on creating new, multiple target attributes without having to manually Add them (using Add Attribute) to a Type, Schema or even from the Transform Operator
• How to create and use an Operator Template
• The power of using shared libraries
• The power of the Transform Operator's parameter rule

I was recently working with a private undergraduate college which wanted to process fixed width ACT data with expressor.

This example follows the data file and reference material available here: The ACT® | Electronic Student Record Layout | ACT

The expressor project available in this post named: ACTDataFixedWidth.zip

Please use the video player settings to adjust the quality and size of the video. View in full screen 720-1080p for best results.



In summary - in order to process a fixed width file with expressor - you would read in the data file record as a single field with a string data type, then use a transform operator and the substring() function to break it apart into the appropriate multiple fields, adjusting the start and end position for each NEW out going attribute.

Attached Thumbnails

 

Attached Files

• ACTDataFixedWidth.zip (111.9 KB)

This video will provide you a brief introduction to expressor Datascript.

Please adjust video players settings to highest definition and full screen for best viewing results.




Reference: Extending expressor with Datascript | Blogs | expressor Community
Documentation: expressor Documentation
Datascript: What is the Datascript Language

Sample project is attached to the end of this post.

Attached Files

• datascript_part1.zip (70.8 KB)

This video will provide you a brief introduction to expressor Datascript.

Please adjust video players settings to highest definition and full screen for best viewing results.






Reference: Extending expressor with Datascript | Blogs | expressor Community
Documentation: expressor Documentation
Datascript: What is the Datascript Language

Sample project is attached to the end of this post.

Attached Files

• datascript_part1.zip (70.8 KB)

Hi, fist of all great product! Been using it for only a day now but really like it

I was wondering if functionality existed in Expressor to create 'notes' either at a workspace or project level? At the moment I'm using a bit of a poor man's solution of creating a .txt file and then importing it as an 'External File' so I can at least see/edit it from the Expressor dashboard.

Thanks in advance!

data_cleanup_notes.PNG

Attached Images

• data_cleanup_notes.PNG (12.1 KB)

Hi,

I've tried searching the forums and Google for these answers, but to no avail.

I have a target table (MS SQL Server 2005) that contains several binary(16) columns. The source file for this table has no mappings to these, we need to use default values.

1) What is the "right" way to define a target default regardlss of datatype (e.g. I want an Integer attribute to have a default of 1)?
2) How can one set a default that is binary(16) in SQL Server/byte in Expressor? (e.g. set a binary(16) with the explicit value of 0xF48DF5A1347E424C8D0989A09669C72F)

Thanks!

Join John Lifter, Principal Customer Success Engineer as he walks you trough creating connection artifacts using expressor Studio.

A Connection specifies the location of resources processed by Input and Output operators in a Dataflow.

There are three types of Connections:

• File
• Database
• Extension - such as Salesforce starting with version 3.5

This video covers simple file and database connections

In this video you will learn how to use:

• Read Lookup Table Operator
• Write Lookup Table Operator
• Lookup Transformation Rule

Please adjust video players settings to highest definition and full screen for best viewing results.





Lookup Table: A persistent store of data that can be used to enrich an existing data record with additional detail form another source.

A note on Lookup Tables:

If accept the default location for a Lookup table, it is placed into the external sub-directory under the compiled version of the project/dataflow, the dfp sub-directory when running from Studio.

(C:\Metadata\
dfp\external)

These table files (*.db3) will be removed each time you run the dataflow even if you have not specified truncate as a Write Lookup Table property.

If you want your lookup tables to be available to other dataflows or to have a lifetime greater than the duration of execution, you should specify a directory location for your File Connection Artifact outside of the expressor project hierarchy.
It’s probably best to always use a specified directory location rather than the default location.





Write Lookup Table Operator: Initializes or updates a Lookup Table, which is a persistent store of data that can be accessed by a Transformation Lookup rule.


Read Lookup Table Operator: Reads the records in a Lookup Table. It is used to send the records to an operator such as Write File that can write them to a readable file. This provides a means for examining the data in the Lookup Table.

Attached Thumbnails

     

Video Tutorial and Sample Project

In this 17 minute expressor Studio tutorial, I will walk you through:

• Connecting to Salesforce
• Creating expressor schemas from the Account, Contact and Case SF objects
• Modify the schemas to rename and removed un-needed attributes
• Use the Join operator to join the SF objects
• Create a new attribute with the Transform operator
• Write out the data to a QlikView (.qvx) file that can be used by the QlikView application
• Create a simple QlikView application

Please use the player controls to adjust quality settings to view the video at its highest resolution and in full screen for best results.




Download the project located as a link at the bottom of this thread in the attachments section.

• Download the .zip file to temp location
• DO NOT Un-zip
• In expressor Studio - under the explorer foldertree select your workspace (top level of tree)
• Right click and select Import Projects...
• ZIP File radio button should be selected
• Browse to location where you saved the .zip file
• Click Next and select the SalesforceToQlikView.0 project and click Finish
• The project will be imported into the workspace
• Expand the project
• Open the SalesforceConnection1 artifact and put in your Salesforce credentials and token Test and save - you can get a SF development account here:
• Open the FileConnection1 artifact and change the path to point to the path where you want to save your .qvx and .txt files

Attached Thumbnails

     

Attached Files

• SalesforceToQlikView_published.zip (1.13 MB)

One feature/option I am finding I would like to have while working with Expressor is the ability to copy\cut and paste an Artifact from one step in a DataFlow into another or even into another DataFlow.

I am currently in the process of trying to update/streamline a couple DataFlows and while I can copy/paste some of the text values in Artifacts, I cannot copy/paste a complete Artifact or sets of Artifacts.

Where this becomes important is if I have a fairly complicated step built in a DataFlow but decide I want to combine that step with another or move it to its own DataFlow, I cannot simply copy/paste it to the new location. I have to drag new Artifacts for each of the old ones onto the new step/location and then reset all the properties manually. This leads to a low of wasted time recreating the DataFlow portions as well as can lead to human errors.

You can view the page at http://community.expressor-software....BC-Connections

You can view the page at http://community.expressor-software....BC-Connections

You can view the page at http://community.expressor-software....ith-Partitions

You can view the page at http://community.expressor-software....BC-Connections