I am making a text editor and for editing a file I really need some sort of way to only read certain bytes from a file, which I've achieved using fs.createReadStream uisng the start and end options.
I also need to replace certain bytes in the file. I am not sure how this can be done. So far the best solution I've come up is to read the file using a stream and then write to a new file, when I come across the bytes I'm looking for I write my new content instead, thus replacing the old stuff with the new stuff.
This is not the best way, as you'll probably know. To edit 4 bytes I am reading a huge 2GB file and writing the 2GB (assuming I'm editing a 2GB file), not efficient in the least.
What is the best way to achieve this? I've spent two weeks doing this and I've also thought of using Buffers, but Buffers load the entire file into memory, which again is unefficient if it's a 2GB file.
How would you achieve replacing certain bytes in a file without reading the entire file and without installing some npm package that has C++ code. I don't want my editor to have to compile C++ code.
If doing that is not straightforward, how about deleting certain bytes from a file without reading the entire file? If I can do that then I can delete the bytes to be replaced and use something like fs.write() to add the ones I want them to be replaced with.
Edit #1:
After playing around, I've found that if I open a file with fs.open with flag r+ and then fs.write that replaces stuff. So if the text is "Lorem ipsum" and I fs.write "!!!!" the result will be "!!!!m ipsum".
This would work fine if only all the stuff I was going to write was the perfect length. :/
I know what to do in the case that the new content isn't the perfect length, but I don't know how. :/ Maybe if there was some sort of "empty byte"...
Edit #2:
So as said above, fs.open (with r+ flags option) + fs.write allow me to overwrite the content in a file without reading the entire file, which is terrific. Now with this I am running into a new problem. Let's take the following file:
one\n
two\n
three\n
If I fs.open at byte 0 and then fs.write "yes", I end up with:
yes\n
two\n
three\n
If I do the same but instead fs.write "niet", I end up with:
niettwo\n
three\n
Notice how the \n character was replaced with the "t", this is because of how fs.write works by replacing bytes when using r+ in fs.open. This is the problem I am trying to solve right now.
How would one go about doing something like "from this byte to this byte, replace it with these other bytes" so my function could be something like function replaceBytes(filePath, newBytes, startByte, endByte) and that would replace only from startByte to endByte, no matter how long newBytes, whether it be shorter or longer than the length of endByte - startByte.
Edit #3:
OK, I figured out the case where the new content is longer than the old content that is being replaced. Thanks to \x00, I've been able to figure it out. In case both the new and the old content are the same length, that's not hard to figure out as there's nothing to do there.
But the case where the old content is shorter than the new content, that's still unresolved.
For those curious, this is the working code for old content longer than new content: https://github.com/noedit/file/blob/592a35134440a03d3e3c3e366f6cda7f565c11aa/lib/replaceBytes.js#L27-L34
Although it does put a null byte in there, which depending on the editor, it may show up as a character and thus looking weird. :/
Copyright Notice：Content Author:「greduan」，Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article：https://stackoverflow.com/questions/30768630/node-js-v0-10-replace-certain-bytes-in-file-without-reading-whole-file