Tags I am associated with:

Tags I am associated with: Microsoft SQL Server, IBM Cognos BI and Planning, Deltek Costpoint, Deltek Time & Expense, Magento, Intuit QuickBooks, Visual Basic 6, SSIS, Oracle, SQL development, data warehouse, reporting, eCommerce, accounting, finance, ETL

Thursday, January 19, 2012

SSIS connection to Oracle server

Really want to get this down before I forget and hopefully this helps someone out there.

Issue: Connecting to an Oracle 10gR1 (can be other versions of 10 and 11 server) source from SSIS, development on Windows 7 x64 bit environment.

Solution: You will have to download the Oracle 11gR2 32-bit client from Oracle web site, do a custom install to only install the OLE DB provider and .NET provider.
Remember that if you want to run the SSIS package on a SQL Server 64-bit server, you will have to download the Oracle 11gR2 64-bit client and install that wherever the SSIS pkg will run.
In SSIS, choose the "Oracle provider for OLE DB", make sure you specify the Oracle servername, port and service name like this in "server or file name":
servername:1521/servicename
This way you DO NOT need to configure tnsnames.ora file. I repeat, you do not have to use archaic methods of configuring connection string.

Additional issue(s): My PATH environment variable is longer than 1023 characters due to many SQL versions. During Oracle client installation which complains about the max length of PATH variable, just ignore it, Windows 7 can handle more that 1023 chars in PATH var.

Wednesday, December 28, 2011

SSIS OLE DB source missing records in SQL Server 2005 SP2

Issue: I found out recently that a SSIS package I was developing was missing random records/rows when extracting data from a complex database view from SQL Server 2005 SP3. I was using the "table or view" data access mode and picking the view from the dropdown list.

Solution/Workaround: After troubleshooting and verifying that nothing was interfering with the extraction (i.e. anti-virus software, etc.), I found a workaround by changing the data access mode to "SQL command" and just typing "select * from " instead. I am pretty sure this is a bug with SSIS, but I don't know if it is caused by my use of common table expressions and linked server in the database view.

Wednesday, November 30, 2011

xcopy - Insufficient memory error

Today, noticed errors were occurring with some of my backup xcopy jobs. When I run the xcopy command via command line, it had something like this at the end of it:

.
.
.
Insufficient memory
376 File(s) copied

C:\>

I did a bit of research and realized that the cause was that some of the filenames in folders to be xcopied had really long names. And coupled with the long path, they were exceeding 254 characters in length. This is a Windows 2003 server, so I downloaded and installed the Windows Server 2003 Resource Kit Tools (http://www.microsoft.com/download/en/details.aspx?id=17657) to use the robocopy.exe along with the /MIR (mirroring switch) .

Now the job runs smoothly without the 254 limitations in path plus filename string .

Monday, September 5, 2011

Magento USPS string is not in UTF-8 error

Issue: After migrating Magento from dev to production environment, USPS shipping method stopped working.

in system.log file, the following error is shown:
Warning: SimpleXMLElement::addAttribute() [simplexmlelement.addattribute]: string is not in UTF-8 in {magento install dir}/app/code/local/Mage/Usa/Model/Shipping/Carrier/Usps.php

Resolved by:
going to Magento Admin console -> Configuration -> System -> Shipping Methods -> USPS, and re-enter/paste your USPS User ID supplied by USPS to you (usually thru email when you first signed up for the account). and hit save configuration.

Magento Error: Base table or view already exists: 1050 Table ’sales_order_status’ already exists

Scenario: After changing permissions on folders/files in var/cache/, the Magento site was crashing with this error:

Base table or view already exists: 1050 Table ’sales_order_status’ already exists

________
It looks as if the software is trying to upgrade from 1.4 to 1.5, but the new tables are already there.

Workaround: Log into database with the MySQL account and run these SQL statements (in the following order to avoid foreign key constraints) to drop the new tables:

drop table sales_order_status_label;
drop table sales_order_status_state;
drop table sales_order_status;
drop table paypal_cert;

After executing these statements, hit the site again via web browser, and the software should recreate the 4 tables along with finishing the upgrade.

Note: I've locked down the permissions on folders and files, but looks like Magento upgrade creates new folder/files with 777 permission owned by apache user. You may have to change the permissions on these new folder/files to your liking...

Saturday, August 6, 2011

Weird permissions error when changing password through SQL Server Management Studio

Ran into a case this week when a business superuser could not change other users' passwords. I checked and the superuser had the securityadmin role. Basically after sleuthing around, I came to the conclusion that the issue is caused by incompatible service pack levels between the database server (which is at SQL Server 2005 SP3) and the business superuser who had recently had to reinstall management studio (but installed a non SP version of the client).

This is not the first time something strange happens when using a lower service pack client against a higher service pack server. I've ran into weird maintenance plan issues before with this scenario...

I just wish Microsoft can just warn users when connecting to a higher service pack SQL Server to help track down issues or to remind to update management studio clients.

Wednesday, August 3, 2011

coalesce() function translated to case expression in SQL Server ?

Error message in SQL Server Management Studio:
Msg 8180, Level 16, State 1, Line 1
Statement(s) could not be prepared.
Msg 125, Level 15, State 4, Line 1
Case expressions may only be nested to level 10.

I just wanted to note this down before I forget... a couple of weeks ago I was deploying a view to a test environment and had to re-point the table source to a linked server and received this message.

the original view was something like this (simplified):
select *
from t
where coalesce(a,b,c,d,e,f,g,h,i,j,k,l) is not null

the above worked when t is on same server.

after pointing t to linked server:
select *
from .dbT.dbo.t
where coalesce(a,b,c,d,e,f,g,h,i,j,k,l) is not null

I got the error msg:
Case expressions may only be nested to level 10.

Apparently, SQL Server translates the coalesce function internally to nested case expressions and ran into some limitations via the linked server interface.

To work around the issue, I rewrote the coalesce function to OR expressions like:
select *
from .dbT.dbo.t
where
(a is not null
or b is not null
or c is not null
or d is not null
.
.
.
or l is not null)