SCDB中發現某些表的date欄位不能正確顯示，導致datastage抽數的時候，抽取資料出錯，表現如下：
SQL> select yycq_rq,to_char(yycq_rq,'yyyy-mm-dd') from db_sc.t_sc_xx ;

YY_RQ TO_CHAR(YY
--------- ----------
?
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00
01-JAN-97 0000-00-00

經查metalink ，文件ID：Date Field Contains All Zeros [ID 312973.1] 給出了明確的解釋，這是因為date欄位中的小時，分鐘，秒的資訊損壞。SXDB中出現此類情況，極可能是當時遷移SXDB的時候造成的。

只要重新將這些壞的欄位重新手工update後，就能解決此問題，並且此問題以後不會再發生。因為如果錄入錯誤的時間，就會報以下的錯：
insert into xxx values ('00-00-0000 00');
ORA-01847: day of month must be between 1 and last day of month

ORACLE 官方提供了詳細的解決方法

首先，建立一個error表，用來記錄有問題的表及欄位，然後建立一個procedure （詳細的script附後），
使用方法：
REM 1. Ensure SPOOL is enabled to catch output and enable SERVEROUT
REM Eg:
REM spool mybaddates.log
REM execute dbms_output.enable(1000000);
REM set serveroutput on
REM 2. Run one of:
BadDate.CheckDB;
BadDate.CheckSchema('SCHEMANAME');
BadDate.CheckObject('SCHEMANAME','TABLENAME');

可以按物件，或者指定表名來檢查.如果有任何的錯誤欄位，會記錄到ERROR表，並會產生一條update語句，讓我們手工更正這個錯誤的欄位。

詳細的指令碼：
Script

REM BADDATE.SQL
REM
REM Purpose: The purpose of this package is to identify invisibly
REM corrupted dates in a database of the form described in
REM the JDBC Alert Note:94185.1 and in Note:91207.1.
REM This form of corruption is subtle in that the displayed
REM form of the date looks correct, but comparisons and sorts
REM do not behave as expected.
REM
REM USAGE
REM ~~~~~
REM The BADDATE package allows you to check a named table, schema or
REM entire database for corrupt DATE values.
REM The idea is that you run this package to get a list of date columns which
REM currently contain dates which seem to be corrupt.
REM The output shows bad row counts along with an UPDATE statement
REM which can be used to repair each bad column.
REM
REM Please note this is an example script only.
REM There is no guarantee associated with the output it presents.
REM
REM Steps to install:
REM 1. Install this package in the SYS schema
REM Eg: connect internal
REM @baddate
REM This should create a BADDATE$$ control table and a
REM BADDATE package.
REM If installing in a 7.1 database then comment out the
REM call to DBMS_APPLICATION_INFO below.
REM
REM Steps to use:
REM 1. Populate the BADDATE$$ table with any tables / columns to ignore
REM If you are not sure you can ignore this step for now.
REM 2. Ensure SPOOL is enabled to catch output and enable SERVEROUT
REM Eg:
REM spool mybaddates.log
REM execute dbms_output.enable(1000000);
REM set serveroutput on
REM 3. Run one of:
REM BadDate.CheckDB;
REM BadDate.CheckSchema('SCHEMANAME');
REM BadDate.CheckObject('SCHEMANAME','TABLENAME');
REM to check the entire database / named schema or named table
REM This will run until all requested items are scanned or
REM an error occurs.
REM If any bad dates are found then the tablename / column and
REM row counts are reported, along with an UPDATE statement
REM which can be used to REPAIR the bad dates.
REM Any UPDATES have to be run manually - this package just gives
REM the SQL for the UPDATE - it does not repair the data.
REM
REM 4. If an error occurs results so far are dumped.
REM Depending on the error you may then:
REM BadDate.LastError; to see the error again
REM BadDate.Continue; to re-start processing at the table
REM we just errored on
REM BadDate.Skip; to mark that we should skip the
REM table we errored on by inserting
REM a row in BADDATE$$
REM 5. If you want some SQL to look at the failing rows in a table
REM in more detail use the GetSQL call:
REM BadDate.GetSQL('OWNER','TABLENAME')
REM to give a select statement for the named table
REM
REM Notes:
REM This package keeps the name of the current owner/table being
REM scanned in V$SESSION in the MODULE and ACTION columns.
REM This can be used to monitor progress.
REM
REM This script should not be used against the SYS schema.
REM
REM =====================================================================
REM Set serverout on and enable a large buffer
REM
set serverout on
execute dbms_output.enable(1000000);

REM =====================================================================
REM Table BADDATE$$
REM =====================================================================
REM This table contains information on Schemas, Tables, Columns
REM and column data values which can be ignored whilst checking for
REM suspect dates by the BADDATE package
REM
REM The table columns are:
REM ITEM This determines what this BADDATE$$ row means:
REM OWNER skips the entire schema for OWNER
REM TABLE skips the entire OWNER . TABLE_NAME
REM COLUMN skips COLUMN_NAME in OWNER . TABLE_NAME
REM OWNER Case sensitive schema name to ignore
REM TABLE_NAME Case sensitive table name to ignore
REM COLUMN_NAME Case sensitive column name to ignore
REM BOOT Should be NULL. Only rows inserted by this script
REM should have a value of 1 allowing this script
REM to be re-run without losing data.
REM This script will delete rows with a value 1.
REM
create table BADDATE$$ (
item varchar2(10), /* COLUMN, TABLE, OWNER */
owner varchar2(30),
table_name varchar2(30),
column_name varchar2(30),
text varchar2(500), /* Description */
boot number
);
create index i_BADDATE$$ on BADDATE$$(
item, owner, table_name, column_name
);

REM =====================================================================
REM Delete pre-existing BOOT data from this script
REM =====================================================================
REM
delete from BADDATE$$ where boot=1;

REM =====================================================================
REM Insert some known special tables / columns into BADDATE$$
REM =====================================================================
REM
insert into BADDATE$$ values
('OWNER','SYS',null,null,'Dont check SYS on DB check',1 );
insert into BADDATE$$ values
('TABLE','SYS','BADDATE$$',null,'Dont check myself',1 );
insert into BADDATE$$ values
('TABLE','SYS','SUMDEP$',null,'P_REF_TIME contains 00-000-00 dates',1);
insert into BADDATE$$ values
('TABLE','SYS','SUMDETAIL$',null,'SPARE4 contains 00-000-00 dates',1);
insert into BADDATE$$ values
('COLUMN','SYS','USER$','PTIME','PTIME contains 00-000-00 dates',1);
insert into BADDATE$$ values
('COLUMN','SYS','USER$','EXPTIME','EXPTIME contains 00-000-00 dates',1);
insert into BADDATE$$ values
('COLUMN','SYS','USER$','LTIME','LTIME contains 00-000-00 dates',1);
commit;

REM
REM =====================================================================
REM BadDate Package
REM =====================================================================
REM
REM
CREATE OR REPLACE PACKAGE BadDate
AS
--
PROCEDURE CheckDb( ShowFixSQL BOOLEAN default TRUE ) ;
PROCEDURE CheckSchema( vowner varchar2, ShowFixSQL BOOLEAN default TRUE ) ;
PROCEDURE CheckObject( vowner varchar2, vtable_name varchar2,
ShowFixSQL BOOLEAN default TRUE ) ;
PROCEDURE LastError;
PROCEDURE Continue;
PROCEDURE GetSQL( vOwner varchar2 , vTable varchar2 ) ;
PROCEDURE Skip;
--
END BadDate;
/

REM =====================================================================
REM BadDate Package Body
REM =====================================================================
REM
CREATE OR REPLACE PACKAGE BODY BadDate
AS
--
DEBUG boolean:=false;
ShowSql boolean:=TRUE;
--
--
--
TYPE t_Col IS TABLE OF VARCHAR2(40) INDEX BY BINARY_INTEGER;
Col t_Col;
--
TYPE t_Num IS TABLE OF NUMBER INDEX BY BINARY_INTEGER;
badCnt t_Num;
--
NCols INTEGER;
--
-- Use these to save current location for error reporting
--
Command varchar2(10);
OnOwner varchar2(30);
OnTable varchar2(30);
OnColumn varchar2(30);
Pos varchar2(255);
Stmt varchar2(32767); -- Keep the core statement global for errors
Frm varchar2(32767); -- Keep the FROM ... WHERE ... here
Err varchar2(32767);
--
-- =====================================================================
-- PRIVATE Putlines(txt)
-- Writes a char string to DBMS_OUTPUT spliting lines as it goes
--
PROCEDURE putlines( txt varchar2 )
IS
p integer:=1;
len integer;
LineLen number:=80;
pos integer;
BEGIN
len:=length(txt);
while (p pos:=instr(substr(txt,p,LineLen),chr(10));
if pos0 then
dbms_output.put_line(substr(txt,p,pos-1));
p:=p+pos;
else
dbms_output.put_line(substr(txt,p,LineLen));
p:=p+LineLen;
end if;
end loop;
END;
--
-- =====================================================================
PROCEDURE Intro
IS
BEGIN
putlines('The output below shows SCHEMA,TABLE and COLUMN name for columns');
putlines('which appear to contain corrupt dates of the form described in ');
putlines('the JDBC Alert Note:94185.1 and in Note:91207.1');
if (ShowSQL) then
dbms_output.new_line;
putlines('Each bad column is followed by an UPDATE statement that');
putlines('will repair the form of corruption described in these notes');
end if;
putlines('~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~');
dbms_output.new_line;
END;
-- =====================================================================
-- PRIVATE BuildStmt( owner, table, star )
-- Builds a SQL statement to scan OWNER.TABLE.
-- If STAR is TRUE all columns are selected, otherwise just the dates
-- we are interested in.
--
PROCEDURE BuildStmt( vowner varchar2, vtable_name varchar2, star boolean )
IS
sep varchar2(10);
--
CURSOR C_DateCols( vowner varchar2, vtable_name varchar2) IS
SELECT rownum, column_name, data_length
FROM dba_tab_columns T
WHERE owner=vowner and table_name=vtable_name
and data_type='DATE'
and NOT EXISTS
( select 1 from BADDATE$$ C
where c.item='COLUMN'
and c.owner=t.owner
and c.table_name=t.table_name
and c.column_name=t.column_name
)
;
--
BEGIN
Pos:='BuildStmt: Begin';
stmt:='SELECT ';
--
if star THEN
stmt:=stmt||'TAB.* '||chr(10);
else
stmt:=stmt||'count(*) '||chr(10);
end if;
--
Pos:='BuildStmt: Build Select';
NCols:=0;
FOR R in C_DateCols(vowner,vtable_name)
LOOP
NCols:=R.rownum;
OnColumn:=R.column_name;
Col(NCols):=R.column_name;
IF star THEN
stmt:=stmt||',dump("'||R.column_name||'") '|| chr(10);
ELSE
badCnt(NCols):=null;
stmt:=stmt||',sum(decode("'||R.column_name||'",
"'||R.column_name||'"+0,0,1))'||chr(10);
END IF;
END LOOP;
IF (NCols<=0) THEN
return;
END IF;
frm:=' FROM "'||vowner||'"."'||vtable_name||'" TAB WHERE (';
sep:=' ';
Pos:='BuildStmt: Build WHERE';
FOR n IN 1 .. NCols
LOOP
OnColumn:=Col(n);
frm:=frm||chr(10)||sep||'("'||Col(n)||'"!="'||Col(n)||'"+0)';
sep:=' OR ';
END LOOP;
frm:=frm||' )';
--
stmt:=stmt||frm;
END;
--
-- =====================================================================
-- PRIVATE TableOK( owner, table )
-- Internal function to check a named TABLE for suspicious dates
--
FUNCTION TableOK( vowner varchar2, vtable_name varchar2) RETURN Boolean
IS
n integer;
rows integer;
cur integer;
ok boolean;
cnt number;
--
BEGIN
IF debug then
dbms_output.put_line('Checking '||vowner||','||vtable_name);
end if;
--
-- WARNING: The line below must be commented out in Oracle7.1
-- as DBMS_APPLICATION_INFO does not exist until 7.2
--
DBMS_APPLICATION_INFO.Set_module('BadDate: '||vowner,vtable_name);
--
OnOwner:=vowner;
OnTable:=vtable_name;
OnColumn:=null;
--
BuildStmt( vowner,vtable_name,false );
--
IF (NCols<=0) THEN
return(true);
END IF;
--
IF debug then putlines(stmt); end if;
--
Pos:='TableOK: Open Cursor';
OnColumn:=null;
cur:= DBMS_SQL.OPEN_CURSOR;
DBMS_SQL.PARSE(cur,stmt, dbms_sql.native);
DBMS_SQL.DEFINE_COLUMN(cur,1,cnt);
FOR n in 1 .. NCols
LOOP
DBMS_SQL.DEFINE_COLUMN(cur,n+1,badCnt(n));
END LOOP;
--
Pos:='TableOK: Execute';
rows:= DBMS_SQL.EXECUTE_AND_FETCH(cur);
--
ok:=TRUE;
IF rows > 0 THEN
Pos:='TableOK: Check Result';
DBMS_SQL.COLUMN_VALUE(cur,1,cnt);
IF (cnt>0) THEN
DBMS_OUTPUT.PUT_LINE('REM '||vowner||'.'||vtable_name||' has '||cnt||
' suspect rows');
FOR n in 1 .. NCols
LOOP
OnColumn:=Col(n);
DBMS_SQL.COLUMN_VALUE(cur,n+1,badCnt(n));
if (badCnt(n)>0) then
DBMS_OUTPUT.PUT('rem Column '||Col(n));
if (badCnt(n)>0) then
DBMS_OUTPUT.PUT_LINE(' has '||badCnt(n)||' Bad dates');
dbms_output.new_line;
if (ShowSQL) then
DBMS_OUTPUT.PUT_LINE('UPDATE "'||vowner||'"."'||vtable_name||'"');
DBMS_OUTPUT.PUT_LINE(' SET "'||Col(n)||'"="'||Col(n)||'"+0');
DBMS_OUTPUT.PUT_LINE(' WHERE "'||Col(n)||'"!="'||Col(n)||'"+0');
DBMS_OUTPUT.PUT_LINE(' AND "'||Col(n)||'">'||
'TO_DATE(''19991231235959'',''YYYYMMDDHH24MISS'')');
DBMS_OUTPUT.PUT_LINE(';');
end if;
end if;
ok:=false;
dbms_output.new_line;
end if;
END LOOP;
dbms_output.new_line;
END IF;
DBMS_SQL.CLOSE_CURSOR(cur);
return(ok);
END IF;
--
DBMS_OUTPUT.PUT_LINE(vowner||'.'||vtable_name||' ERROR '||sqlerrm);
DBMS_SQL.CLOSE_CURSOR(cur);
return(false);
END;
--
-- =====================================================================
-- PRIVATE SchemaOK( owner, table )
-- Internal function to check a named SCHEMA for suspicious dates
-- If TABLE is specified this is the start point. If NULL all tables
-- for this schema are scanned.
--
FUNCTION SchemaOK( vowner varchar2, vStartTable varchar2 default NULL )
RETURN Boolean
IS
CURSOR C_Tables( vowner varchar2, vStartTable varchar2 ) IS
SELECT table_name
FROM dba_tables T
WHERE owner=vowner
and (vStartTable is null OR table_name>=vStartTable)
and NOT EXISTS
( select 1 from BADDATE$$ C
where c.item='TABLE'
and c.owner=t.owner
and c.table_name=t.table_name
)
order by table_name
;
--
ok boolean:=TRUE;
BEGIN
Pos:='SchemaOK';
OnOwner:=vowner;
OnTable:=null;
OnColumn:=null;
Stmt:=null;
--
FOR T in C_Tables( vowner,vStartTable )
LOOP
IF NOT TableOK(vowner,T.table_name) THEN
ok:=false;
END IF;
END LOOP;
return(ok);
END;
--
-- =====================================================================
-- PRIVATE DbOK( owner, table )
-- Internal function to check an entire database.
-- Owner / Table specify a starting owner / table to use.
--
FUNCTION DbOK( vStartOwner varchar2 default null,
vStartTable varchar2 default null ) RETURN Boolean
IS
CURSOR C_Users IS
SELECT username FROM dba_users
WHERE (vStartOwner is null OR username>=vStartOwner)
AND NOT EXISTS
(select 1 from BADDATE$$
where item='OWNER'
and owner=username)
order by username
;
--
ok boolean:=true;
BEGIN
Pos:='DbOK';
OnOwner:=null;
OnTable:=null;
OnColumn:=null;
Stmt:=null;
--
FOR U in C_Users
LOOP
IF NOT SchemaOK(U.username,vStartTable) THEN
ok:=false;
END IF;
END LOOP;
return(ok);
END;
--
-- =====================================================================
-- PUBLIC FUNCTIONS
-- =====================================================================
-- PUBLIC Object( owner, table )
-- External interface to check an OBJECT (OWNER.TABLE)
--
PROCEDURE OBJECT( vowner varchar2, vtable_name varchar2)
IS
BEGIN
Command:='OBJECT';
if (TableOK(vowner,vtable_name)) then
DBMS_OUTPUT.PUT_LINE('Table check for '||vowner||'.'||vtable_name||
' found no corrupt dates');
end if;
Command:=null;
EXCEPTION
When others THEN
Err:=sqlerrm;
LastError;
raise;
END;
--
-- External interface to check a schema database
--
PROCEDURE CheckObject( vowner varchar2, vtable_name varchar2,
ShowFixSQL BOOLEAN default TRUE )
IS
BEGIN
ShowSQL:=ShowFixSQL;
Intro;
Object(vowner,vtable_name);
END;
--
-- =====================================================================
-- PUBLIC Schema( owner, table )
-- External interface to check a SCHEMA (OWNER)
--
PROCEDURE Schema( vowner varchar2, vStartTable varchar2 default NULL )
IS
BEGIN
Command:='SCHEMA';
if (SchemaOK(vowner,vStartTable)) then
DBMS_OUTPUT.PUT_LINE('Schema check for '||vowner||
' found no corrupt dates');
end if;
Command:=null;
EXCEPTION
When others THEN
Err:=sqlerrm;
LastError;
raise;
END;
--
-- External interface to check a schema database
--
PROCEDURE CheckSchema( vowner varchar2, ShowFixSQL BOOLEAN default TRUE )
IS
BEGIN
ShowSQL:=ShowFixSQL;
Intro;
Schema(vowner);
END;
--
-- =====================================================================
PROCEDURE Db ( vStartOwner varchar2 default null,
vStartTable varchar2 default null )
IS
BEGIN
Command:='DB';
if (DbOK(vStartOwner,vStartTable)) then
DBMS_OUTPUT.PUT_LINE('CheckDB found no corrupt dates');
end if;
Command:=null;
EXCEPTION
When others THEN
Err:=sqlerrm;
LastError;
raise;
END;
--
-- External interface to check a complete database
--
PROCEDURE CheckDb( ShowFixSQL BOOLEAN default TRUE )
IS
BEGIN
ShowSQL:=ShowFixSQL;
Intro;
DB;
END;
--
-- =====================================================================
-- PUBLIC Continue( )
-- External interface to continue processing where we left off in
-- case of Object, Schema or DB checks
--
PROCEDURE Continue
IS
Tab varchar2(30);
Own varchar2(30);
BEGIN
Tab:=OnTable;
Own:=OnOwner;
IF Command is not null THEN
dbms_output.put_line('CONTINUING Check'||Command||
' from '||Own||'.'||Tab);
dbms_output.new_line;
ELSE
dbms_output.put_line('Nothing to CONTINUE from...');
return;
END IF;
IF Command='DB' THEN
DB(Own,Tab);
ELSE
IF Command='SCHEMA' THEN
Schema(Own,Tab);
ELSE
IF Command='OBJECT' THEN
Object(Own,Tab);
ELSE
dbms_output.put_line('Cannot CONTINUE '||Command);
END IF;
END IF;
END IF;
END;
--
-- =====================================================================
-- PUBLIC GetSQL( owner, table )
-- External interface to show an SQL statement which selects
-- suspect rows from OWNER.TABLE
--
PROCEDURE GetSQL( vOwner varchar2 , vTable varchar2 )
IS
BEGIN
BuildStmt(vowner,vtable,true);
putlines(stmt);
dbms_output.put_line(';');
END;
--
-- =====================================================================
-- PUBLIC LastError
-- Displays the last stored error from this package
--
PROCEDURE LastError
IS
BEGIN
dbms_output.new_line;
dbms_output.put_line('Last BadDate Error:');
dbms_output.put_line(' Pos: '||Pos);
dbms_output.put_line(' At: '||OnOwner||'.'||OnTable||'.'||OnColumn);
dbms_output.put_line('Stmt:');
putlines(Stmt);
dbms_output.put_line('Error:');
putlines(Err);
END;
--
-- =====================================================================
-- PUBLIC Skip
-- If a BADDATE.CheckDB / SCHEMA / OBJECT errored then the object name
-- we were on is marked for skipping over in the BADDATE$$ table.
--
PROCEDURE Skip
IS
BEGIN
IF Command is not null THEN
dbms_output.put_line('Inserting '||OnOwner||'.'||OnTable||
' into BADDATE$$ to skip it' );
insert into BADDATE$$ values
('TABLE',OnOwner,OnTable,null,'User request to SKIP this',0 );
COMMIT;
ELSE
dbms_output.put_line('No error occured to SKIP');
END IF;
END;
--
-- =====================================================================
--
BEGIN
-- Initialize DBMS_OUTPUT
dbms_output.enable(1000000);
END;
/

REM =====================================================================
REM END of BADDATE.SQL
REM =====================================================================

解決生產庫date欄位顯示不正確

相關文章