Noesis tutorial Basic Model

[MaZTeR]

The download link doesn't work. I really need this tool ASAP :)

[eri619]

please re upload the images,tutorial without images are pretty useless.No offence.

[dragoncrest]

can you make a tutorial about animation?
thanks.

[Tosyk]

in noesis, how to skip junk data like texture path at the beginning of If the length of this path is before it?

[shakotay2]

bs = NoeBitStream(data)
lenStr = bs.readUShort()# 2 bytes for length of pathstring
bs.seek(lenStr, NOESEEK_REL)# skip path

for one byte string length use lenStr = bs.readByte()
for DWORD (4 bytes) string length use lenStr = bs.readInt()

(not tested but should work)

[dibe91]

I have a problem. I'm trying to create a script that can import dark souls 2 models by modifying an old dark souls script 1. if I try to import a dark souls 2 model of the basic version of the game, it works correctly:



while if I try to import a model of dark souls 2 scholar of the first sin this happens to me:



I leave you the complete script. I have only changed the type of model to be imported.

Code: Select all

'''Dark Souls 2 .flv model importer.

Note that there are little and big endian versions of the game, and they
are basically the same format. Therefore, all'''

from inc_noesis import *
import noesis
import rapi
import os

logd = open("darksouls2.log","w")

def registerNoesisTypes():
    '''Register the plugin. Just change the Game name and extension.'''
    
    handle = noesis.register("Dark Souls2", ".flv")
    noesis.setHandlerTypeCheck(handle, noepyCheckType)
    noesis.setHandlerLoadModel(handle, noepyLoadModel)
    return 1

def noepyCheckType(data):
    '''Verify that the format is supported by this plugin. Default yes'''
    
    if len(data) < 16:
        return 0
    try:
        bs = NoeBitStream(data)
        idstring = noeStrFromBytes(bs.readBytes(6))
        if idstring == "FLV":
            return 1
        return 0
    except:
        return 0
    
def get_endian(data):
    
    bs = NoeBitStream(data)
    bs.seek(6)
    endian = bs.readByte()
    if endian == 0x4C: # "L"
        return 0
    elif endian == 0x42: # "B"
        return 1 

def noepyLoadModel(data, mdlList):
    '''Build the model, set materials, bones, and animations. You do not
    need all of them as long as they are empty lists (they are by default)'''
    
    endian = get_endian(data)
    ctx = rapi.rpgCreateContext()
    parser = SanaeParser(data, endian)
    parser.parse_file()
    mdl = rapi.rpgConstructModel()
    mdl.setModelMaterials(NoeModelMaterials(parser.texList, parser.matList))
    mdl.setBones(parser.boneList)
    mdl.setAnims(parser.animList)
    mdlList.append(mdl)
    return 1

def logD(what):
    logFile = open("fmt_DarkSouls2_flv.log")

class FLV_mesh(object):
    
    def __init__(self):
        
        self.numFaceGroups = 0
        self.numIndices = []
        self.idxOffsets = []
        self.idxBuffs = [] #one mesh may have multiple parts
        self.numVerts = 0
        self.vertSize = 0
        self.vertOfs = 0
        self.vertSectionSize = 0
        self.vertBuff = bytes()
        self.uvBuff = bytes()
        self.matIds = 0

class FLV_mat(object):
    def __init__(self):
        self.Name1 = ""
        self.MTDName = ""
        self.texName = ""
        self.nParams = 0
        self.paramStartIndex = 0
        self.unknown0 = 0

class SanaeParser(object):
    
    def __init__(self, data, endian=0):
        
        self.inFile = NoeBitStream(data, endian)
        self.animList = []
        self.texList = []
        self.matList = []
        self.boneList = []
        self.meshList = []
        self.materialList = []
        self.dataOfs = 0 #offset to mesh data        
        if endian:
            rapi.rpgSetOption(noesis.RPGOPT_BIGENDIAN, 1)
        
    def build_meshes(self):
        
        rapi.rpgSetOption(noesis.RPGOPT_TRIWINDBACKWARD, 1)
        for mesh in self.meshList:
            
            print(mesh.vertSize)
            #rapi
            if mesh.vertSize == 28:
                rapi.rpgBindPositionBufferOfs(mesh.vertBuff, noesis.RPGEODATA_FLOAT, 28, 0)
                #noesis.doException("vertSize = 28, UVs not implemented...yet")
                rapi.rpgBindUV1BufferOfs(mesh.uvBuff,noesis.RPGEODATA_FLOAT,8,0)
            elif mesh.vertSize == 32:
                rapi.rpgBindPositionBufferOfs(mesh.vertBuff, noesis.RPGEODATA_FLOAT, 32, 0)
                #rapi.rpgBindNormalBufferOfs(mesh.vertBuff, noesis.RPGEODATA_FLOAT, 32, 20)
                rapi.rpgBindUV1BufferOfs(mesh.uvBuff,noesis.RPGEODATA_FLOAT,8,0)
                #rapi.rpgBindUV1BufferOfs(mesh.vertBuff, noesis.RPGEODATA_HALFFLOAT, 32, 16)
                #noesis.doException("vertSize = 32, UVs not implemented...yet")
            elif mesh.vertSize == 36:
                rapi.rpgBindPositionBufferOfs(mesh.vertBuff, noesis.RPGEODATA_FLOAT, 36, 0)
                rapi.rpgBindUV1BufferOfs(mesh.uvBuff,noesis.RPGEODATA_FLOAT,8,0)
                #noesis.doException("vertSize = 36, UVs not implemented...yet")
            elif mesh.vertSize == 40:
                rapi.rpgBindPositionBufferOfs(mesh.vertBuff, noesis.RPGEODATA_FLOAT, 40, 0)
                rapi.rpgBindUV1BufferOfs(mesh.uvBuff,noesis.RPGEODATA_FLOAT,8,0)
                
                #rapi.rpgBindUV1BufferOfs(mesh.vertBuff, noesis.RPGEODATA_HALFFLOAT,40,36)
            elif mesh.vertSize == 44:
                rapi.rpgBindPositionBufferOfs(mesh.vertBuff, noesis.RPGEODATA_FLOAT, 44, 0)
                rapi.rpgBindUV1BufferOfs(mesh.uvBuff,noesis.RPGEODATA_FLOAT,8,0)
                #noesis.doException("vertSize = 44, UVs not implemented...yet")
            
            #for j in range(mesh.numFaceGroups): # Not sure
            for j in range(1):
                numIdx = mesh.numIndices[j]
                idxBuff = mesh.idxBuffs[j]
                rapi.rpgSetMaterial(self.materialList[mesh.matIds].Name1)
                rapi.rpgCommitTriangles(idxBuff, noesis.RPGEODATA_USHORT, numIdx, noesis.RPGEO_TRIANGLE_STRIP, 1)
            #rapi.rpgCommitTriangles(None, noesis.RPGEODATA_USHORT, mesh.numVerts, noesis.RPGEO_POINTS, 1)
                
            
    def get_indices(self, numIdx):
        
        return self.inFile.readBytes(numIdx*2)

    def jnr(self,offs):
        oldOffs = self.inFile.tell()
        self.inFile.seek(offs)
        eos = False
        #strEnd = '00'.decode('hex')
        tmpBuffer = ""
        while not eos:
            tmpByte = self.inFile.readBytes(1)
            self.inFile.readBytes(1)
            tmpChar = ord(tmpByte)
            if(ord(tmpByte) == 0):
                eos = True
                break
            else:
                tmpBuffer += str(chr(ord(tmpByte)))
        self.inFile.seek(oldOffs)
        return tmpBuffer

    def jnr2(self,offs):
        oldOffs = self.inFile.tell()
        self.inFile.seek(offs)
        eos = False
        #strEnd = '00'.decode('hex')
        tmpBuffer = ""
        while not eos:
            tmpByte = self.inFile.readBytes(1)
            self.inFile.readBytes(1)
            tmpChar = ord(tmpByte)
            if(ord(tmpByte) == 0):
                eos = True
                break
            else:
                tmpBuffer += str(chr(ord(tmpByte)))
        newOffs = self.inFile.tell()
        self.inFile.seek(oldOffs)
        return [tmpBuffer,newOffs]

    def parse_faces(self):
        
        for mesh in self.meshList:
            for i in range(mesh.numFaceGroups):
                numIdx = mesh.numIndices[i]
                idxOfs = mesh.idxOffsets[i]
                self.inFile.seek(idxOfs)
                idxBuff = self.get_indices(numIdx)
                mesh.idxBuffs.append(idxBuff)
                
                
    def parse_vertices(self):
        
        for mesh in self.meshList:
            self.inFile.seek(mesh.vertOfs)
            #logd.write(str(mesh.vertSize) + " : " + str(mesh.vertOfs) + "," + str(mesh.vertSectionSize) + "\n")
            mesh.vertBuff = self.inFile.readBytes(mesh.vertSectionSize)
            #if(mesh.vertSize == 40):
            for i in range(mesh.numVerts):
                vS = mesh.vertSize
                vPos = i * vS
                tmpVert = mesh.vertBuff[vPos:vPos+mesh.vertSize]
                vU = struct.pack("f",float(struct.unpack("h",tmpVert[(vS-4):(vS-2)])[0] / 1024.0))
                vV = struct.pack("f",float(struct.unpack("h",tmpVert[(vS-2):(vS)])[0] / 1024.0))
                mesh.uvBuff += vU
                mesh.uvBuff += vV


    def resolveTextureName(self,inName):
        tmpName1 = inName.split('\\')
        logd.write(str(tmpName1[len(tmpName1)-1].split('.')))
        tmpName2 = tmpName1[len(tmpName1) - 1].split('.')
        type1 =  self.myWD + "\\" + self.myOutDIR + "\\" + tmpName2[0] + ".dds"
        type2 =  self.myWD + "\\" + self.myOutDIR + "\\" + tmpName2[0] + "_n [Unknown24].dds"
        logd.write("TYPE1: " + type1)
        #type1 = self.findInSubDir(tmpName2[0] + ".dds")
        #if(type1 == -1):
        #    return (tmpName2[0] + ".dds")
        #else:
        #    return type1
        return [type1,type2]
                        
                    

    def findInSubDir(self,filename,subdirectory = ''):
        logd.write("myWD = " + self.myWD + "\n")
        if subdirectory:
            path = subdirectory
        else:
            path = self.myWD
            for root, dirs, names in os.walk(path):
                if filename in names:
                    return os.path.join(root,filename)
                else:
                    return -1





    def parse_materials(self, numMat):
        for m in range(numMat):# in self.materialList:
            logd.write("PARSE MATERIAL INFO: " + str(self.inFile.tell()) + "\n")
            Name1 = self.jnr(self.inFile.readUInt())
            tmpMatThing = self.jnr2(self.inFile.readUInt())
            MTDName = tmpMatThing[0]
            tmpTexz = self.resolveTextureName(self.jnr(tmpMatThing[1]))
            texName = tmpTexz[0]
            normalName = tmpTexz[1]
            nParams = self.inFile.readUInt()
            paramStartIndex = self.inFile.readUInt()
            unknown0 = self.inFile.readUInt()
            self.inFile.read('3L')
            #logd.write("MATERIAL {}: {}\n".format(mat.Name1,mat.texName))
            mat = FLV_mat()
            mat.Name1 = Name1
            self.materialList.append(mat)
            
            material = NoeMaterial(Name1,texName)
            material.setNormalTexture(normalName)
            self.matList.append(material)

            
    def parse_bones(self, numBones):
        
        for i in range(numBones):
            self.inFile.seek(64, 1)
            
    def parse_unk1(self, count):
        
        for i in range(count):
            #logd.write("unk1: " + str(self.inFile.tell()))
            self.inFile.seek(128, 1)
            
    def parse_part_info(self, numParts):
        
        for mesh in self.meshList:
            #logd.write("part_info: " + str(self.inFile.tell()) + "\n")
            logd.write("PARSE PART INFO: " + str(self.inFile.tell()) + "\n")
            self.inFile.read('1L')
            matIds = self.inFile.readUInt()
            self.inFile.read('6L')
            numFaceGroups = self.inFile.readUInt()
            self.inFile.read('3L')
            #logd.write("NUM FACESGROUPS:" + str(numFaceGroups) + "\n")
            mesh.numFaceGroups = numFaceGroups
            mesh.matIds = matIds
            
    def parse_face_info(self):
        
        for mesh in self.meshList:
            for i in range(mesh.numFaceGroups):
                groupNum = self.inFile.readUInt()
                self.inFile.readUInt()
                numIdx = self.inFile.readUInt()
                #logd.write("NUM FACES:" + str(numIdx) + "\n")
                idxOfs = self.inFile.readUInt() + self.dataOfs
                idxSize = self.inFile.readUInt()
                self.inFile.read('3L')
                
                mesh.numIndices.append(numIdx)
                mesh.idxOffsets.append(idxOfs)
                            
    def parse_vertex_info(self):
        
        for mesh in self.meshList:
            self.inFile.read('1L')
            vertDescriptor = self.inFile.read('1L')
            vertSize = self.inFile.readUInt()
            numVerts = self.inFile.readUInt()
            self.inFile.readUInt()
            unk = self.inFile.readUInt()
            sectionSize = self.inFile.readUInt()
            vertOfs = self.inFile.readUInt() + self.dataOfs
            
            mesh.numVerts = numVerts
            mesh.vertSize = vertSize
            mesh.vertOfs = vertOfs
            mesh.vertSectionSize = sectionSize
            
    def getfdir(self):
        tmpDir = rapi.getInputName().split('\\')
        myCWD = ''
        for i in range(len(tmpDir) - 1):

            if(i == (len(tmpDir) - 2)):
                myCWD += tmpDir[i]
            else:
               myCWD += tmpDir[i] + '\\'
        
        return [myCWD,tmpDir[len(tmpDir) - 1].split('.')[0]]



    def parse_file(self):
        '''Main parser method'''
        tmpTing = self.getfdir()
        self.myWD = tmpTing[0]
        self.myOutDIR = tmpTing[1] +"_unpack"
        logd.write("myOutDIR = " + self.myOutDIR + "\n")
        
        

        #logd.write(rapi.getInputName())
        #header
        idstring = self.inFile.readBytes(6)
        
        #version?
        unk, type1, type2 = self.inFile.read('3H')
        
        self.dataOfs = self.inFile.readUInt()
        dataSize = self.inFile.readUInt()
        numBones = self.inFile.readUInt()
        numMat = self.inFile.readUInt()
        count = self.inFile.readUInt()
        numParts = self.inFile.readUInt()
        numMesh = self.inFile.readUInt()
        
        #create some mesh objects
        for i in range(numMesh):
            mesh = FLV_mesh()
            self.meshList.append(mesh)

        #for i in range(numMat):
        #    mat = FLV_mat()
        #    self.materialList.append(mat)
        
        self.inFile.read('6f')
        self.inFile.seek(64, 1)
        self.parse_bones(numBones)
        self.parse_materials(numMat)
        self.parse_unk1(count)
        self.parse_part_info(numParts)
        self.parse_face_info()        
        logd.write("PARSE VERTEX INFO: " + str(self.inFile.tell()) + "\n")
        self.parse_vertex_info()
        logd.write("PARSE FACES: " + str(self.inFile.tell()) + "\n")
        #parse data
        self.parse_faces()
        logd.write("PARSE VERTS: " + str(self.inFile.tell()) + "\n")
        self.parse_vertices()
        logd.write("END FILE ACCESS? " + str(self.inFile.tell()) + "\n")
        self.build_meshes()

[tainhx]

Need tutorial for import Bone and Animation

[shakotay2]

For skeleton bones look here:
https://forum.xentax.com/viewtopic.php?f=29&t=19429

You may read here, too:
viewtopic.php?f=13&t=14446&hilit=NoeKeyFramedValue

Be sure to read this documentation located in Noesis/Plugins/Python/__NPReadMe.txt
as advised by Gh0stBlade.

[rusian]

hi
how do i print opened filename and path

[JosouKitsune]

Ok so now we will add in our normals and uv coordinates.
rapi.rpgBindUV1BufferOfs(VertBuff, noesis.RPGEODATA_FLOAT, 88, 48)

Hi chrrox, I'm trying to create a python script to extract the Gintama Rumble models from the PS4 version.
I'm using hex2obj as guide, trying to pars the values I found to a Noesis py script using your rapi tutorial, the problem is that in hex2obj the UVs are in WORDUV and the UV POS is 40 with a vertex size of 44.



My question is how to re-write the quoted line using this information?
Cause I tried using
rapi.rpgBindUV1BufferOfs(VertBuff, noesis.RPGEODATA_USHORT, 44, 40)
But the UVs came out so tiny.



This is my script.

Code: Select all

from inc_noesis import *
import noesis
import rapi

def registerNoesisTypes():
	handle = noesis.register("Gintama Rumble PS4",".tmd")
	noesis.setHandlerTypeCheck(handle, noepyCheckType)
	noesis.setHandlerLoadModel(handle, noepyLoadModel)
	return 1
	
NOEPY_HEADER = "tmd0"

def noepyCheckType(data):
   bs = NoeBitStream(data)
   if len(data) < 4:
      return 0
   if bs.readBytes(4).decode("ASCII") != NOEPY_HEADER:
      return 0
   return 1  

def noepyLoadModel(data, mdlList):
	ctx = rapi.rpgCreateContext()
	bs = NoeBitStream(data)
	bs.seek(0xcc, NOESEEK_ABS)
	FCount = bs.read("i")
	bs.seek(0xc, NOESEEK_REL)
	VCount = bs.read("i")
	bs.seek(0x70, NOESEEK_ABS)
	FAddress = bs.readUInt()
	bs.seek(0x1c, NOESEEK_REL)
	VAddress = bs.readUInt()
	#print("{} {} {} {}".format(FCount[0]*3, VCount[0], hex(FAddress), hex(VAddress)))
	bs.seek(VAddress, NOESEEK_ABS)
	VertBuff = bs.readBytes(VCount[0] * 0x2c)
	#print("\n{}".format(VertBuff))
	rapi.rpgBindPositionBufferOfs(VertBuff, noesis.RPGEODATA_FLOAT, 44, 0)
	rapi.rpgBindUV1BufferOfs(VertBuff, noesis.RPGEODATA_USHORT, 44, 40)
	bs.seek(FAddress, NOESEEK_ABS)
	FaceBuff = bs.readBytes(FCount[0] * 6)
	rapi.rpgCommitTriangles(FaceBuff, noesis.RPGEODATA_USHORT, FCount[0]*3, noesis.RPGEO_TRIANGLE, 1)
	mdl = rapi.rpgConstructModel()
	mdlList.append(mdl)
	
	rapi.rpgClearBufferBinds()
	return 1

Here is the sample file.

[chrrox]

your options for uv's if they are 4 bytes would be
PYNOECONSTN(RPGEODATA_SHORT),
PYNOECONSTN(RPGEODATA_USHORT),
PYNOECONSTN(RPGEODATA_HALFFLOAT),
I would try short instead of ushort.

[JosouKitsune]

your options for uv's if they are 4 bytes would be
PYNOECONSTN(RPGEODATA_SHORT),
PYNOECONSTN(RPGEODATA_USHORT),
PYNOECONSTN(RPGEODATA_HALFFLOAT),
I would try short instead of ushort.

Thanks, I tried the SHORT option and it did upscale, but not by much and the HALFFLOAT option shrank the UVs.
Is there a way to upscale the UVs automatically?
The scale parameter in the export options doesn't seem to affect the UVs.

[bymutou]

your options for uv's if they are 4 bytes would be
PYNOECONSTN(RPGEODATA_SHORT),
PYNOECONSTN(RPGEODATA_USHORT),
PYNOECONSTN(RPGEODATA_HALFFLOAT),
I would try short instead of ushort.

Thanks, I tried the SHORT option and it did upscale, but not by much and the HALFFLOAT option shrank the UVs.
Is there a way to upscale the UVs automatically?
The scale parameter in the export options doesn't seem to affect the UVs.

I looked at other people's py scripts and they used this action to zoom in on uv: {"rpgSetUVScaleBias", RPGSetUVScaleBias, METH_VARARGS, "sets uv coordinate scale and bias - pass None, None to disable. (OO|i)"}, //args=NoeVec3 (scale), NoeVec3 (bias), optional uv index - or None, None

[JosouKitsune]

your options for uv's if they are 4 bytes would be
PYNOECONSTN(RPGEODATA_SHORT),
PYNOECONSTN(RPGEODATA_USHORT),
PYNOECONSTN(RPGEODATA_HALFFLOAT),
I would try short instead of ushort.

Thanks, I tried the SHORT option and it did upscale, but not by much and the HALFFLOAT option shrank the UVs.
Is there a way to upscale the UVs automatically?
The scale parameter in the export options doesn't seem to affect the UVs.

I looked at other people's py scripts and they used this action to zoom in on uv: {"rpgSetUVScaleBias", RPGSetUVScaleBias, METH_VARARGS, "sets uv coordinate scale and bias - pass None, None to disable. (OO|i)"}, //args=NoeVec3 (scale), NoeVec3 (bias), optional uv index - or None, None

Thanks for this, the UVs are looking fine now.





Though the factor I ended up with was 32.0285, such a weird scale, there may be a better one.

Code: Select all

rapi.rpgSetUVScaleBias((32.0285,32.0285,32.0285),None)

[11H5]

if anyone can help will be great !

after inspect element from sketchfab i saved this files .
zip files .

file.osgjs
model_file.bin
model_file_wireframe.bin

now i'm trying to open this files in Noesis to see the 3d model , but i can't .

maybe there's a plugin i can add to Noesis so it would work ?