Join also our Discord channel! Click here.

Noesis g1m/g1t/g1a importer

Post questions about game models here, or help out others!
Post Reply
icoee
ultra-n00b
Posts: 5
Joined: Wed Jan 31, 2018 8:50 am

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by icoee » Sun Mar 08, 2020 10:29 am

Thanks for your script. But when I try to export the PC00B g1m file from Atelier Ryza, get an error: WARNING: Weight contains an out of range bone index. Discarding model. Please help!!!

Here is the file: https://mega.nz/#!89wykQwB!vi0v9NTKKmHv ... u6cNX-Kf4Y

User avatar
Joschka
veteran
Posts: 154
Joined: Fri Aug 09, 2019 3:51 pm
Has thanked: 35 times
Been thanked: 199 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Joschka » Sun Mar 08, 2020 1:52 pm

Allanoon wrote:
Fri Mar 06, 2020 1:14 am
...
einherjar007 wrote:
Sat Mar 07, 2020 2:47 am
...
Great news, thanks for testing ! I'll try to make the optimization I talked about before to make the script run faster this week, the few Nioh samples I tried took quite a bit of time to load.
Allanoon wrote:
Fri Mar 06, 2020 1:14 am
Maybe on koei fandom but even there titles seems to be missing, i also didn't notice that Personas are from Atlus while DQ builders is Square Enix despite using the same engine of many Koei games. Maybe there're some more lost in other company xD
Yep basically KT do their own games but also work with other studios sometimes, for example Hyrule Warriors and Fire Emblem for Nintendo and the others you mentionned. I actually had no idea that they made DQB2 before you mentionned it for example, thought the game was made by Square internally.
I think the best thing to do would just be to edit that wikipedia list at that point, it has most of the titles already.
icoee wrote:
Sun Mar 08, 2020 10:29 am
Thanks for your script. But when I try to export the PC00B g1m file from Atelier Ryza, get an error: WARNING: Weight contains an out of range bone index. Discarding model. Please help!!!

Here is the file: https://mega.nz/#!89wykQwB!vi0v9NTKKmHv ... u6cNX-Kf4Y
Your model had some cloth type 2 with the new physics bones I implemented for Dissidia in the last updates. But I didn't know these meshes could have bone indices to the main armature too, which was the case in your model. I pushed a fix for that, should now work as expected.

icoee
ultra-n00b
Posts: 5
Joined: Wed Jan 31, 2018 8:50 am

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by icoee » Sun Mar 08, 2020 7:13 pm

Joschka wrote:
Sun Mar 08, 2020 1:52 pm
Allanoon wrote:
Fri Mar 06, 2020 1:14 am
...
einherjar007 wrote:
Sat Mar 07, 2020 2:47 am
...
Great news, thanks for testing ! I'll try to make the optimization I talked about before to make the script run faster this week, the few Nioh samples I tried took quite a bit of time to load.
Allanoon wrote:
Fri Mar 06, 2020 1:14 am
Maybe on koei fandom but even there titles seems to be missing, i also didn't notice that Personas are from Atlus while DQ builders is Square Enix despite using the same engine of many Koei games. Maybe there're some more lost in other company xD
Yep basically KT do their own games but also work with other studios sometimes, for example Hyrule Warriors and Fire Emblem for Nintendo and the others you mentionned. I actually had no idea that they made DQB2 before you mentionned it for example, thought the game was made by Square internally.
I think the best thing to do would just be to edit that wikipedia list at that point, it has most of the titles already.
icoee wrote:
Sun Mar 08, 2020 10:29 am
Thanks for your script. But when I try to export the PC00B g1m file from Atelier Ryza, get an error: WARNING: Weight contains an out of range bone index. Discarding model. Please help!!!

Here is the file: https://mega.nz/#!89wykQwB!vi0v9NTKKmHv ... u6cNX-Kf4Y
Your model had some cloth type 2 with the new physics bones I implemented for Dissidia in the last updates. But I didn't know these meshes could have bone indices to the main armature too, which was the case in your model. I pushed a fix for that, should now work as expected.
It works!! Thanks very much!
But now I found a ploblem for the hair of other model after export.

Here is the file : https://mega.nz/#!hlYG2aba!oKr4O4ARw1fa ... T5-Fr3-h4c
You do not have the required permissions to view the files attached to this post.

User avatar
howfie
double-veteran
double-veteran
Posts: 930
Joined: Fri Jul 08, 2011 12:06 pm
Location: Torrance, CA
Has thanked: 10 times
Been thanked: 268 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by howfie » Sun Mar 08, 2020 10:10 pm

Excellent work guys! Will be sure to try it out! I see you guys actually figured out what the vertex shader was doing rather than trying to just interpret the byte code like I did :mrgreen: .

User avatar
Yretenai
veteran
Posts: 91
Joined: Tue Jan 28, 2020 4:39 pm
Has thanked: 14 times
Been thanked: 91 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Yretenai » Mon Mar 09, 2020 2:07 am

howfie wrote:
Sun Mar 08, 2020 10:10 pm
Excellent work guys! Will be sure to try it out! I see you guys actually figured out what the vertex shader was doing rather than trying to just interpret the byte code like I did :mrgreen: .
There's still a bit to go, normals are re-generated in the vertex shader in newer versions. It's causing a bit of a headache, but we're back to interpreting bytecode :mrgreen:

fullinu
beginner
Posts: 29
Joined: Fri May 13, 2016 11:56 am
Has thanked: 25 times
Been thanked: 1 time

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by fullinu » Mon Mar 09, 2020 11:18 am

edit:
there was a problem here, it's gone now
Last edited by fullinu on Mon Mar 09, 2020 6:56 pm, edited 1 time in total.

User avatar
Joschka
veteran
Posts: 154
Joined: Fri Aug 09, 2019 3:51 pm
Has thanked: 35 times
Been thanked: 199 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Joschka » Mon Mar 09, 2020 1:00 pm

icoee wrote:
Sun Mar 08, 2020 7:13 pm
It works!! Thanks very much!
But now I found a ploblem for the hair of other model after export.
Looks like your were unlucky enough to find the 3rd NUN mesh that doesn't work among the hundred others that work fine. I guess that my cloth computation must be slightly off somewhere, fixing that in non trivial unfortunately and I don't want to do some hack that could break other models so better wait for us to update the equations when we'll add proper normal support for the cloth meshes.
howfie wrote:
Sun Mar 08, 2020 10:10 pm
Excellent work guys! Will be sure to try it out!
The gas machine man himself ! Really glad to see you here Semory ! :D
As mentionned in the credits all of this wouldn't have been possible without your gas machine source code as a basis, thanks a ton for your hard work on these formats ! (as you can see they're still milking their engine with only a few changes...)
howfie wrote:
Sun Mar 08, 2020 10:10 pm
I see you guys actually figured out what the vertex shader was doing rather than trying to just interpret the byte code like I did :mrgreen: .
Oh don't worry we still have almost no clue about what's actually happening, the shader code has just been converted to a more compact form hehe
I did find similar ideas with the control points and all in APEX clothing but I think they did their own solution. I'll probably look a bit more into it soon now that most bugs are solved, as you can see above there are still some rare cases where it gives some weird results.

What we have so far is that there's a computation of the center of mass of the 4 closest control points using the 4 components of the 4D vertices of the cloth meshes as weights for each one (done in what I've called processClothVertex). Then these centers of mass are themselves used in another weighted sum to get a final vector (so the center of mass of the center of masses) This is repeated 3 times to get all the vectors (d4,d5,d6)
Then these vectors are used in a scalar triple product and the resulting values are fed to the vector components of the position vector
Last edited by Joschka on Mon Mar 09, 2020 3:39 pm, edited 1 time in total.

icoee
ultra-n00b
Posts: 5
Joined: Wed Jan 31, 2018 8:50 am

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by icoee » Mon Mar 09, 2020 3:21 pm

Joschka wrote:
Mon Mar 09, 2020 1:00 pm
Looks like your were unlucky enough to find the 3rd NUN mesh that doesn't work among the hundred others that work fine. I guess that my cloth computation must be slightly off somewhere, fixing that in non trivial unfortunately and I don't want to do some hack that could break other models so better wait for us to update the equations when we'll add proper normal support for the cloth meshes.
Ok, I get it now, thanks!

User avatar
Joschka
veteran
Posts: 154
Joined: Fri Aug 09, 2019 3:51 pm
Has thanked: 35 times
Been thanked: 199 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Joschka » Mon Mar 09, 2020 8:46 pm

icoee wrote:
Mon Mar 09, 2020 3:21 pm
Joschka wrote:
Mon Mar 09, 2020 1:00 pm
Looks like your were unlucky enough to find the 3rd NUN mesh that doesn't work among the hundred others that work fine. I guess that my cloth computation must be slightly off somewhere, fixing that in non trivial unfortunately and I don't want to do some hack that could break other models so better wait for us to update the equations when we'll add proper normal support for the cloth meshes.
Ok, I get it now, thanks!
This custom script will fix your model, normals are not computed correctly though but this is easier to fix in a 3d software. Only use it for that model, it's just a quick and dirty hack until a proper fix.
Image
You do not have the required permissions to view the files attached to this post.

icoee
ultra-n00b
Posts: 5
Joined: Wed Jan 31, 2018 8:50 am

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by icoee » Tue Mar 10, 2020 12:43 pm

Joschka wrote:
Mon Mar 09, 2020 8:46 pm
This custom script will fix your model, normals are not computed correctly though but this is easier to fix in a 3d software. Only use it for that model, it's just a quick and dirty hack until a proper fix.
Image
It's awesome!! Thank you so much!!!

User avatar
Joschka
veteran
Posts: 154
Joined: Fri Aug 09, 2019 3:51 pm
Has thanked: 35 times
Been thanked: 199 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Joschka » Tue Mar 10, 2020 2:02 pm

Pushed a quick fix for BE models. Fatal Frame models should now be fully supported, with cloth meshes fixed.
Still have no immediate plans for texture support since it's the only one using Wiiu swizzle, don't really want to implement that for just one game.
Image

Crazy31139
advanced
Posts: 69
Joined: Fri Dec 02, 2016 5:53 pm
Has thanked: 148 times
Been thanked: 29 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Crazy31139 » Wed Mar 11, 2020 9:24 am

Hi, i try open Noesis and see this error, maybe you can help me
You do not have the required permissions to view the files attached to this post.

User avatar
Joschka
veteran
Posts: 154
Joined: Fri Aug 09, 2019 3:51 pm
Has thanked: 35 times
Been thanked: 199 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Joschka » Wed Mar 11, 2020 1:42 pm

Crazy31139 wrote:
Wed Mar 11, 2020 9:24 am
Hi, i try open Noesis and see this error, maybe you can help me
viewtopic.php?f=16&t=21666#p159400

User avatar
Joschka
veteran
Posts: 154
Joined: Fri Aug 09, 2019 3:51 pm
Has thanked: 35 times
Been thanked: 199 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by Joschka » Wed Mar 11, 2020 3:59 pm

icoee wrote:
Tue Mar 10, 2020 12:43 pm
It's awesome!! Thank you so much!!!
I did more research and pushed a universal fix for that so you won't need the custom script anymore, just download the latest version and you should be good. Thank you for the bug report, made me aware of that error.
Just need to fix the normals properly and I think the script will be pretty much complete. After that I'll be able to focus on optimization.

All the models should now import correctly for all games, cloth/hair meshes included.

User avatar
shenglong
ultra-n00b
Posts: 3
Joined: Fri Jan 04, 2019 8:18 am
Has thanked: 15 times

Re: Noesis g1m/g1t importer with animations (FETH, Dissidia, DOA6, FEW, HW...)

Post by shenglong » Tue Mar 17, 2020 11:56 am

Hello, thank you very much for sharing such an excellent tool.

I'm also analyzing G1M files, so I'd like to ask you some questions about the G1M file format:

1.What is the structure of the G1M file? (PC platform file).

2.The vertex data at the beginning of the 0x04000100 mark in the GM1G4400 block contains vertex structures described as 0x7C size. I guess these structures are cloth physical meshes, because I can't extract mesh data correctly, they always appear as flat meshes. How can I correctly analyze these data?

3.What is the structure of ONUN8200 and VNUN1100 blocks?

The above questions have perplexed me for a long time. I hope to get your answer. Thank you again!
Undertake not what you cannot perform,but be careful to keep your promise.
——[USA]George Washington

Post Reply