FILE ON OCFS CANNOT BE DELETED LINUX ERROR: 16: DEVICE OR RESOURCE BUSY

Bug No.	3535621
Filed	26-MAR-2004	Updated	29-SEP-2006
Product	Linux OS	Product Version	9.2.0.4
Platform	Red Hat Enterprise Linux Advanced Server Itanium	Platform. Version	2.1
Database Version	9.2.0.4	Affects Platforms	Port-Specific
Severity	Severe Loss of Service	Status	Closed, Not a Bug
Base Bug	N/A	Fixed in Product Version	No Data

Problem statement:

FILE ON OCFS CANNOT BE DELETED LINUX ERROR: 16: DEVICE OR RESOURCE BUSY

---

 
 
*** 03/26/04 12:28 am *** 
TAR: 
---- 
. 
PROBLEM: 
-------- 
This is 2 node RAC system where R1.0.10-1 is used. 
A data file can't be deleted by 'rm' command after drop tablespace. 
. 
SQL> create tablespace mahya datafile 
  2  '/ocfs9204/oradata/o9204/mahya01.dbf' size 10M; 
Tablespace created. 
. 
SQL> 
-- 
SQL> drop tablespace mahya; 
Tablespace dropped. 
-- 
[ora9204@jpcom414c o9204]$ rm mahya01.dbf 
rm: cannot unlink `mahya01.dbf': Device or resource busy 
. 
DIAGNOSTIC ANALYSIS: 
-------------------- 
I can't any errors in messages, despite of setting OCFS DEBUG. 
 echo -1 > /proc/sys/kernel/ocfs/debug_level 
 echo -1 > /proc/sys/kernel/ocfs/debug_context 
But CT's one have some errors. Ct use OCFS R1.0.9-12. 
. 
Mar 12 00:22:38 sufg1e14 kernel: (19116) ERROR: status = -16,  
Common/ocfsgendlm.c, 1586 
Mar 12 00:22:38 sufg1e14 kernel: (19116) ERROR: status = -16,  
Common/ocfsgencreate.c, 1027 
Mar 12 00:22:38 sufg1e14 kernel: (19116) ERROR: status = -16,  
Common/ocfsgencreate.c, 1770 
. 
This problem can occur only  
-when connection of 'create tablespace' remains, 
-when create and delete are performed from separate node 
. 
When this problem occurs, the result of 'lsof' command is as follows.  
Server process which performed 'create tablespace' is holding the file. 
. 
[root@jpcom4159 root]# lsof /ocfs9204/oradata/o9204/mahya01.dbf 
COMMAND   PID    USER   FD   TYPE DEVICE     SIZE    NODE NAME 
oracle  18080 ora9204   18u   REG   8,65 10493952 2691584  
/ocfs9204/oradata/o9204/mahya01.dbf 
. 
from ps, PID=18080 is server process which performed 'create tablespace'  
ora9204  18080 18079  0 15:58 ?        00:00:00 oracleo92041  
(DESCRIPTION=(LOCAL 
. 
WORKAROUND: 
----------- 
none 
. 
RELATED BUGS: 
------------- 
none 
. 
REPRODUCIBILITY: 
---------------- 
Rep?    Platform. RDBMS Ver.  
------- ------------------------------ ----------  
Y(100%) 46-Intel Based Server LINUX    9.2.0.4.0 
. 
TEST CASE: 
---------- 
NODE1: create tablespace and leaves this connection(SQL*Plus). 
NODE2: drop tablespace 
any NODE: rm < datafile> 
. 
STACK TRACE: 
------------ 
none 
. 
SUPPORTING INFORMATION: 
----------------------- 
I put files.tar.Z on ess30 in /bug3535621/ 
. 
[files of CT] 
R9.2.0.4(RAC) 
OCFS R1.0.9-12 
OS:Red Hat Linux Advanced Server release 2.1AS 
-alert_FGNB1001.log 
-messages.log 
. 
[files of me] 
R9.2.0.4(RAC) 
OCFS R1.0.10-1 
OS:Red Hat Linux Advanced Server release 2.1AS 
. 
I set OCFS DEBUG when following create-drop tablespace. 
-messades_4159 
 [alert_o92041.log] 
 Fri Mar 26 15:59:02 2004 
 create tablespace mahya datafile 
 '/ocfs9204/oradata/o9204/mahya01.dbf' size 10M 
 Fri Mar 26 15:59:14 2004 
 Completed: create tablespace mahya datafile 
-messages_414c 
 [alert_o92042.log] 
 Fri Mar 26 15:58:03 2004 
 drop tablespace mahya 
 Fri Mar 26 15:58:04 2004 
 Completed: drop tablespace mahya 
. 
24 HOUR CONTACT INFORMATION FOR P1 BUGS: 
---------------------------------------- 
N/A 
. 
DIAL-IN INFORMATION: 
-------------------- 
N/A 
. 
IMPACT DATE: 
------------ 
N/A 
. 
*** 03/26/04 12:39 am *** 
*** 03/26/04 02:04 am *** (CHG: Asg->NEW OWNER) 
*** 03/26/04 02:11 am *** (CHG: Sta->10) 
*** 03/26/04 02:11 am *** 
*** 03/28/04 04:49 pm *** (CHG: Sta->16) 
*** 03/28/04 04:49 pm *** 
*** 03/28/04 06:34 pm *** (CHG: Sta->11 G/P->P Asg->NEW OWNER) 
*** 03/28/04 06:34 pm *** 
*** 03/29/04 11:10 am *** (CHG: Sta->32 Asg->NEW OWNER) 
*** 03/29/04 11:10 am *** 
*** 03/30/04 10:09 am *** (CHG: Sta->92) 
*** 04/26/04 06:05 am *** (CHG: Sta->11) 
*** 04/26/04 06:05 am *** 
*** 04/28/04 02:06 am *** 
*** 04/28/04 02:51 pm *** (CHG: Sta->92) 
*** 04/28/04 02:51 pm *** 
*** 09/29/06 04:46 pm *** (CHG: Comp->OCFS)