[Help] Importing EBSD .h5 files into DREAM3D / DREAM3D-NX (“Original Data source could not be determined”)

[王一攀]

Dear experts  ,

I’m a new user who just started learning how to use DREAM.3D for EBSD data processing, and I recently encountered several issues while trying to import `.h5` EBSD files. My question might be quite basic, but I’d really appreciate your guidance.

### Dataset Information

* Dataset source: **3D\_EBSD\_Dataset\_Slices1to176\_h5**
  (downloaded from a public 3D EBSD dataset repository)
* Each file name: `DotProd_718_microVol_XXX.h5`
* Each `.h5` file contains datasets like:

  ```
  Scan 1/EBSD/Data/EulerAngles
  Scan 1/EBSD/Data/IQMap
  Scan 1/EBSD/Data/CIMap
  Scan 1/EBSD/Data/Phase
  ```
  I can read these datasets in Python (using `h5py`), so the files seem valid.

### 🧭 What I Tried

#### 1. In **DREAM3D-NX**

* Filter used: `Import Orientation File(s) to H5EBSD`
* Input directory: `/Users/wangyipan/Downloads/3D_EBSD_Dataset_Slices1to176_h5`
* Total files found: 176
* Prefix: `DotProd_718_microVol_`
* Extension: `.h5`

**Error message:**

```
Parameter Name: 'Input File List'
Validation Error: FILE DOES NOT EXIST
```

Then I tried to open a single file using **Read H5EBSD** filter:

```
/Users/wangyipan/Downloads/3D_EBSD_Dataset_Slices1to176_h5/DotProd_718_microVol_176.h5
```

The software showed:

> H5EBSD File Needs Updating.
> The transformation information stored in the file does not meet the latest specification.
> Should DREAM3D update the file for you?

After clicking “OK”, another message appeared:

> Original Data source could not be determined.
> It should be TSL, HKL or HEDM.

---

#### 2. In **DREAM3D v6.x (Legacy)**

I tried again using the classic **Read H5EBSD** filter.
Even after manually selecting:

* Manufacturer: TSL
* Use Recommended Transformations ✅
* Euler Representation: Radians

I still get the same message:

```
Original Data source could not be determined.
It should be TSL, HKL or HEDM.
```


### ⚙️ My Understanding

I noticed that my `.h5` files don’t contain any “Manufacturer” or “Header” attributes (like `Manufacturer: TSL`), which DREAM.3D seems to expect.
They only include the EBSD data arrays (`EulerAngles`, `IQMap`, `CIMap`, etc.) — without the metadata.

So I’m wondering:

1. Can DREAM.3D open such EBSD `.h5` files without manufacturer metadata?
2. Is there any tool or script to convert these `.h5` files into the proper `.h5ebsd` format?
3. Is this functionality different between **DREAM3D-NX** and **v6.x**?

---

### 💻 Environment

* macOS (Apple Silicon M3)
* DREAM.3D v6.5.171
* DREAM3D-NX 2024.02.07
* Example file path: `/Users/wangyipan/Downloads/3D_EBSD_Dataset_Slices1to176_h5/DotProd_718_microVol_176.h5`

---

### 🙏 Request

I’m still new to DREAM.3D and EBSD data processing, so any suggestions, examples, or documentation would be extremely helpful.
In particular, I’d love to understand what the correct **H5EBSD file structure** should look like, and whether it’s possible to import my dataset after some conversion.

Thank you so much for your time and for maintaining this amazing software!

Best regards,
**Wang Yipan**
Graduate student (beginner user)

[Michael Jackson]

Hello,

    From your description, it looks like these are TSL HDF5 based EBSD files. These are NOT .h5ebsd files. The filter that you are looking for is “Read EDAX OIM Analysis Data (.h5)”. 

You can read in a single scan from the file with each instance of the filter.

--
Mike Jackson

--
You received this message because you are subscribed to the Google Groups "dream3d-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dream3d-user...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dream3d-users/d9643421-e3f4-4a28-ab83-bd87e5f166a9n%40googlegroups.com.