Failed to create data container

  • 0
  • 1
  • Problem
  • Updated 3 years ago
  • Solved
  • (Edited)
Hi all,

during the creation process of a new cointainer I received the following error:

Error:Failed to create data container "vDB1" because of an error creating the default branch for the data container.

Error Code:
exception.jetstream.create.container.failed.default.branch

Suggested Action:
Try again or contact the administrator.

Because I have retried the operation several times and I haven't got an administrator to contact to ;-), I'm asking you if there is something that I can do.

After the error I see that the Status of the VDB associated (I was intending to associate)  with the container is "FAILED".

Thank you in advance.
Gianpiero
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb

Posted 4 years ago

  • 0
  • 1
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
This is likely because Delphix was not able to create a snapshot of the VDB when it created it. Go into the Admin Portal and look at the VDB. Is there a snapshot timecard there? Can you post a screen shot of that and the back of the VDB card? (click the arrow on the vdb).
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
Thank you for you reply. My Landshark is 1.5.5.
I repeated the test: I created a new VDB again from ds of a Physical Oracle 10.2.0.2.0 DB.
I ensured of the presence of the first snapshot of the VDB1. I took a second snapshot of the VDB1 (it was uncredibly fast! :-) and zero space consuming). Into the Jetstream Portal I created a new container, but few seconds after I received the error. See the screenshots in the attachments. Thank you. Now I'm going to repeat the test but I want to take a snapshot of the source first.




(Edited)
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
Unfortunately the last test has failed even though I took a new snapshot of my dsource and then a new snapshot of my vDB before creating the container. However during the container creation process I saw other cards reporting other errors but I was not able to read into those windows because they appeared and disappeared too much fastly. Where can I read those errors? There is a place where I can get some sort of log files?
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
As a test, can you please delete the VDB, and create a new one? Don't take any snapshots, it should create an initial one. Once the initial provision is done, add it to a jetstream container. Let me know the outcome of these steps, please.
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
The first test I did was exactly executed as you describe. Unfortunately I received the same error.
(Edited)
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
Gianpiero, can you look in the dashboard for the jog log of your VDB creation and see if any errors exist in the log?
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
OK, This is easy. The simplest explanation as to what caused this is that the Delphix Engine was rebooted, or suspended, while the VDB was enabled. But, here is the easy way for you to clear it up. Delete the VDB. Disable any other VDB's that are running on that same machine. Now, rebooting the machine is the easiest way to clear the stale mount. But you can alternatively just sudo umount -f /mount/delphix/VDB1.  You should also see no current NFS mounts, at this point. If all is clear, you can now enable your VDB's.
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
Hi Adam,

I repeated your steps, but I have the same error: during the container creation process the directory becomes "stale" and Delphix cannot mount the remote NFS directory.

I confirm that the environment is on my laptop and so I shutdown the Engine, source and target every day without disabling any VDB.

I'm gonna delete the ds link and recreate new one.

Thank you for your support.
Gianpiero
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
After deleting the DS Link and re creating it from scratch, I created all necessary step, but I receive the same error:

Unable to mount directory "/mount/delphix/VDB1". Cause: Unable to mount directory: ERROR_CODE=101
ERROR : Mount directory "/mount/delphix/VDB1" could not be created by user "delphix_os"
ERROR : Could not mount "172.16.180.3:/domain0/group-36/oracle_db_container-1903/oracle_timeflow-1932" at "/mount/delphix/VDB1"
ERROR : Details : ls: cannot access /mount/delphix/VDB1: Stale file handle;Trying "mkdir" using dlpx_pfexec - mkdir: cannot create directory `/mount/delphix/VDB1': File exists;
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
Well, on the Target you are trying to provision to has a stale NFS mount for that directory. If you rebooted the Target machine, it would no longer present. What is the output of the mount command on that Target machine? Also, the output of fuser -m /mount/delphix/VDB1?
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
I confirm that after reboot there aren't any stale directories. After this clean situation I did:
  1. Provision a new VDB -> successfull (the directory is mounted correctly)
  2. Create a new Container with the VDB.
Just during the creation of the cointainer I get the error.
Thank you
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
Hmmm. So this only happens when you are creating a new container. Are you SSH'd or otherwise logged into the target server when you create the container? Something is holding that directory open. When you get the stale mount error message, do you see any files in the VDB1 directory? what does fuser -m /mount/delphix/VDB1 show?
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 2,336 Points 2k badge 2x thumb
Hi Adam,

sorry for my late reply. I was busy this week. With the new LandShark 2.0, the problem doesn't appear again. I can create container as well.

Thank you for you support.
Gianpiero
Photo of Adam Bowen

Adam Bowen, Official Rep

  • 17,420 Points 10k badge 2x thumb
Fantastic. I am going to mark this as resolved.