XeNTaX Forum Index
Forum MultiEx Commander Tools Tools Home
It is currently Sun Apr 23, 2017 10:50 am

All times are UTC + 1 hour


Forum rules


Please click here to view the forum rules



Post new topic Reply to topic  [ 16 posts ]  Go to page 1, 2  Next
Author Message
 Post subject: Warthunder/Dagor Engine archives.
PostPosted: Sun Mar 23, 2014 11:42 am 
Offline
ultra-n00b

Joined: Mon Mar 17, 2014 1:48 pm
Posts: 4
Has thanked: 0 time
Have thanks: 2 times














You can make the ads go away by registering

So I have been spending the last few days trying to decipher the archive files in the free to play game "WarThunder".
Developed by Gaijin entertainment, it uses their in house "Dagor" engine.
According to its wikipedia page(Russian) there are at least 19 games using the engine.
However, I am only interested in WarThunder.

This topic has already been somewhat discussed for a different game(Blades of Time) here: viewtopic.php?f=10&t=8794&hilit=vromfs

The WarThunder game files contain a few different types of archive files.
I have had varying levels of success trying to decipher them.

The main archive types within the game are:
  • vromfs.bin
  • dxp.bin
  • grp
  • blk

vromfs.bin
Header Bytes: 56 52 46 73 00 00 50 43(VRFs PC)
Description:
VROMFS archives are fairly basic.
They consist of 6 parts. All lengths and addresses are Little Endian.
A 16 byte header with the file type and the location of the footer and optionally the length of the decompressed data.
A 32 byte subheader with the location of the file name locations, the file locations and the number of files.
A section describing the location of the file names(Length=8 x filecount).
A section containing the file names. File names are null terminated.
A section describing the locations and lengths of the files(Length=8 x filecount, First 4 bytes is location, next 4 is length).
A section containing the file data.
A 110 byte footer of unknown content(probably some sort of checksum or signature)

vromfs files may optionally be zlib deflated.
If compressed the compression will start at 0x10, also the decompressed file length will be in the header.
I wrote a basic tool to extract files from these archives.
You can download it from github.(Requires Java 1.7)

dxp.bin
Header Bytes: 44 78 50 32 02 00 00 00 (DxP2)
Description:
These archives appear to contain textures is DDS format.
These files appear similar in layout to the vromfs files, however they seem to contain an extra section for DDS headers.
I could probably extract these and if I knew anything about DDS files/headers I might be able to do something useful with them.
At the moment they aren't my top priority.

grp
Header Bytes: 47 52 50 32 (GRP2)
Description:
I dont really know what these files contain. Probably 3d models. Based on the names.
Its fairly simple to get a file listing, but I haven't been able to get much further than that.
I am hesitant to put much effort into these as I don't know if there is any useful data inside.

blk
Header Bytes:00 42 42 46 02 00 00 00 (BBF)
Description:
These are the files I am most interested in the the moment.
These files appear to be compiled markup.
The vromfs archives are full of these.
There is one example of a user editable uncompiled blk file in the root directory of the game (config.blk).
The uncompiled file is JSON like, it has nested key values with explicit types.
I would like to be able to convert the compiled blk's back to the plaintext version.

Here is a shortened example of the plaintext version:
Code:
forcedLauncher:i=0
cloudsQuality:t="high"
doShowDriversOutdated:b=yes
graphicsQuality:t="user"
renderer2:t="auto"

video{
  mode:t="fullscreen"
  postfx_antialiasing:t="high_fxaa"
  vsync:b=no
  resolution:t="2560 x 1440"
}

graphics{
  shadowQuality:t="medium"
  texquality:t="high"
  anisotropy:i=8
  numCloudLayers:i=80
  fxTexScale:r=0.25
  lastClipSize:i=8192
  fxDensityMul:r=0.9
}

render{
  selfReflection:b=yes
  motionBlur:b=no
  ssaoQuality:i=0
}

Compared to a hex dump of a compiled version(different data):
Image

So there are a few thing I would like some help with:
First of all, if anyone knows of any tools that work with these files, or knows where I can get dagor engine dev kits, then that would be appreciated.

Otherwise, I would like some help decompiling the blk files. Maybe someone can help decipher them for me.
Some hints on what to do with the DDS files would be helpful too.

If anyone needs sample files let me know, otherwise WarThunder is free to play and it can be downloaded quite easily.
You can then use my above tool to extract the vromfs files.


Last edited by WatchDog on Mon May 04, 2015 7:22 am, edited 2 times in total.

Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Sun Mar 23, 2014 9:49 pm 
Offline
M-M-M-Monster veteran
M-M-M-Monster veteran

Joined: Wed Mar 31, 2010 6:54 am
Posts: 1592
Has thanked: 59 times
Have thanks: 735 times
Very nice. Tested on Blades of Time ?


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Sun Mar 23, 2014 10:05 pm 
Offline
Moderator
User avatar

Joined: Sun May 18, 2008 3:01 pm
Posts: 2396
Has thanked: 56 times
Have thanks: 1129 times
Yeah I have been working on these games.
The problem is I can not find the compressed size for model files.
I have no idea where its stored.


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Mon Mar 24, 2014 8:16 am 
Offline
ultra-n00b

Joined: Mon Mar 17, 2014 1:48 pm
Posts: 4
Has thanked: 0 time
Have thanks: 2 times
Ekey wrote:
Very nice. Tested on Blades of Time ?

No, I haven't tried it on any other games.


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Sat Apr 19, 2014 2:17 pm 
Offline
ultra-n00b

Joined: Mon Mar 17, 2014 1:48 pm
Posts: 4
Has thanked: 0 time
Have thanks: 2 times
So I just found out that there are official tools available for this game: http://warthunder.com/en/news/541-The-W ... der-CDK-en


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Wed Oct 29, 2014 8:53 am 
Offline
mega-veteran
mega-veteran

Joined: Sun Apr 06, 2014 8:06 pm
Posts: 183
Has thanked: 214 times
Have thanks: 6 times
WatchDog wrote:
So I just found out that there are official tools available for this game: http://warthunder.com/en/news/541-The-W ... der-CDK-en

This tool cannot export model for browsing


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Sun Nov 16, 2014 11:33 pm 
Offline
ultra-n00b

Joined: Fri Oct 31, 2014 5:29 pm
Posts: 5
Has thanked: 4 times
Have thanks: 0 time
someone has created a tool to at least extract .vromfs.bin and dxp.bin archives

http://forum.warthunder.com/index.php?/ ... extractor/


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Thu Nov 20, 2014 11:05 am 
Offline
ultra-n00b

Joined: Thu Nov 20, 2014 10:59 am
Posts: 1
Has thanked: 0 time
Have thanks: 0 time
Are you still interrested in compiling/decompiling BBF (BLK) files?
I know, that this format is used to build requests/responses of your actions in (at least) hangar (War Thunder). And I have to give you some requests/responses and describe you them. Also I can intercept more requests/responses from client.


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Sun Nov 23, 2014 12:22 pm 
Offline
mega-veteran
mega-veteran

Joined: Sun Apr 06, 2014 8:06 pm
Posts: 183
Has thanked: 214 times
Have thanks: 6 times
InnerCircle wrote:
someone has created a tool to at least extract .vromfs.bin and dxp.bin archives

http://forum.warthunder.com/index.php?/ ... extractor/
Thank you, this is very good news, this model has done a very fine game, I really like, I hope everyone can participate in the game, this is the download address tool : http://www.nexusmods.com/warthunder/mods/617/?


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Fri May 01, 2015 1:56 am 
Offline
ultra-n00b

Joined: Mon Mar 17, 2014 1:48 pm
Posts: 4
Has thanked: 0 time
Have thanks: 2 times
kol93 wrote:
Are you still interrested in compiling/decompiling BBF (BLK) files?
I know, that this format is used to build requests/responses of your actions in (at least) hangar (War Thunder). And I have to give you some requests/responses and describe you them. Also I can intercept more requests/responses from client.

I am still interested, i haven't done any work on this for quite a while, but I would like to have another crack at it.


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Fri Jun 26, 2015 6:15 pm 
Offline
ultra-n00b

Joined: Fri Jun 26, 2015 6:12 pm
Posts: 1
Has thanked: 0 time
Have thanks: 0 time
Any recent progress on this? I would like to extract the model files.


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Thu Dec 03, 2015 7:07 am 
Offline
ultra-veteran
ultra-veteran
User avatar

Joined: Wed Jul 06, 2011 8:47 am
Posts: 350
Location: Russia
Has thanked: 523 times
Have thanks: 163 times
Working tools here: https://github.com/klensy/wt-tools
But nothing for grp unpack/convert :(


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Thu Dec 03, 2015 7:53 am 
Offline
beginner

Joined: Tue Nov 24, 2015 10:03 pm
Posts: 20
Has thanked: 15 times
Have thanks: 1 time
Blender 2.49b .grp import script.

viewtopic.php?p=73250#p73250

Tested on Blades of Time, it works. Gives geometry and uv


Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Fri Dec 04, 2015 9:40 am 
Offline
ultra-veteran
ultra-veteran
User avatar

Joined: Wed Jul 06, 2011 8:47 am
Posts: 350
Location: Russia
Has thanked: 523 times
Have thanks: 163 times
DXFan619 wrote:
Blender 2.49b .grp import script.

Not working, I'll try to ask author for update it for WT.

I track how game loads model, by logging file reads at the moment I switched to Leopard 1 tank preview:
Code:
Q:\Games\WarThunder\ui\tex.vromfs.bin
Q:\Games\WarThunder\res\germ_gm.grp
Q:\Games\WarThunder\res\collision_pack.grp
Q:\Games\WarThunder\res\gm_logic.grp
Q:\Games\WarThunder\res\germ_gm.grp
Q:\Games\WarThunder\res\gm.dxp.bin
Q:\Games\WarThunder\res\lowquality_gm.dxp.bin
Q:\Games\WarThunder\content\pkg_main\res\pkg_main_gm.dxp.bin
Q:\Games\WarThunder\content\pkg_main\res\pkg_main_tanks\germ_leopard_1.dxp.bin
Q:\Games\WarThunder\ui\tex.vromfs.bin
Q:\Games\WarThunder\content\pkg_main\res\pkg_main_tanks\germ_leopard_1.dxp.bin
Q:\Games\WarThunder\content\hq_tex\res\hq_tex_lowquality_gm.dxp.bin

Looks like all german tanks groupped into one big file (125 Mb) germ_gm.grp
Script not loads anything if I try to import this GRP, but log looks promising (attached).
I try also small plane file from res\aircrafts\a5m.grp - log looks similar:
Code:
GRP


(232, 232, 329636, 128, 3, 0, 0, 140, 3)
0 a5m4_cockpit_skeleton
1 a5m4_cockpit
2 a5m4_cockpit_anim
0 (109, 27, 248, 86) (256, 0, 0, 0, 55748, 46263)
1 (224, 58, 0, 0) (1, 0, 34553, 16581, 38224, 4)
2 (2, 0, 0, 0) (55748, 46263, 1, 1, 0, 0)
SECTION


Samples of GRP's is uploaded here (114 Mb).


Attachments:


You do not have the required permissions to view the files attached to this post. Register to gain access.



Top
 Profile  
 
 Post subject: Re: Warthunder/Dagor Engine archives.
PostPosted: Fri Jun 03, 2016 6:55 am 
Offline
ultra-n00b

Joined: Fri Jun 03, 2016 6:19 am
Posts: 1
Has thanked: 0 time
Have thanks: 0 time
Andrakann wrote:
Working tools here: https://github.com/klensy/wt-tools
But nothing for grp unpack/convert :(


I have a server responses to client requests from hangar. They have blk format (Header Bytes:00 42 42 46 02 00 00 00). But this utility are not completely unpacked server responses.
Anyone can help me?


Attachments:


You do not have the required permissions to view the files attached to this post. Register to gain access.



Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 16 posts ]  Go to page 1, 2  Next

All times are UTC + 1 hour


Who is online

Users browsing this forum: No registered users and 11 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group