How to determine position within a text file under FSO model?

1,445

Expert 1GB

Hi,

I had answered this a few days ago.

Use "ReadAll" Method, and Split for vbCrLF, you will get Array's ubound as No. of Lines..:

Expand|Select|Wrap|Line Numbers

 
    Dim FSO As New Scripting.FileSystemObject

    Dim TArr

    Dim fsStr As TextStream

    '

    Set fsStr = FSO.OpenTextFile("C:\MyText.txt", ForReading)

    TArr = Split(fsStr.ReadAll, vbCrLf)

    MsgBox "Total Number Of Lines : " & UBound(TArr)

    fsStr.Close

    Set FSO = Nothing

Regards
Veena

Sep 27 '07 #3

8,435

Expert 8TB

Use "ReadAll" Method, and Split for vbCrLF, you will get Array's ubound as No. of Lines..:

Thanks for the idea.

I'd rather not, though. I am already counting the number of lines, so I don't need a way to do that (though yours may be faster). Since each file is at least 100-200MB in size, I don't want to be making copies of it all over my RAM. That's why I'm processing it line by line.

Sep 27 '07 #4

8,435

Expert 8TB

Do you want to add a progressbar or any slider type thing.

I already have a progress bar, thanks. What I'm looking for is a better way to determine where I'm up to in the file. In other words, I'm looking for an equivalent of the old Seek() function.

Sep 27 '07 #5

1,445

Expert 1GB

Hi,

FSO dosent have any equivalent of "Seek" operation, you have to settle for IO's Seek. Or write a Seek Function of your own.

Regards
Veena

Sep 28 '07 #6

1,977

1GB

I already have a progress bar, thanks. What I'm looking for is a better way to determine where I'm up to in the file. In other words, I'm looking for an equivalent of the old Seek() function.

I think this Article page will help you

How To Seek Past VBA's 2GB File Limit

Sep 28 '07 #7

8,435

Expert 8TB

Thanks for trying, people, but I guess I'll just have to accept that with the FSO model, MS in their wisdom have thrown out the whole concept of "where I'm up to". No wonder their progress indicators are so inaccurate.

Hari, thanks for the link, but I've already seen that article (some years ago). I'm not trying to go beyond 2GB, just want to know my position within a file. I can't use things like Seek() because I'm not using Open.

Looks as though I only have two real options...

Live with the two-step process I'm using now. That is, first count all the lines, then count them again while processing them to track position, or
Go back to good old Open and Line Input # processing, and use Seek() function to track progress.
Just thought of another alternative while I was typing. Since I can easily determine the file size, I can just add up the length of each line as I go, plus 2 for the delimiters, to track my progress. Yippee!

Sep 28 '07 #8

1,977

1GB

If you don’t mind! Can you post some part of code and let me do some research? (Of-course it will help me to learn.)

Sep 29 '07 #9

1,977

1GB

Hari, thanks for the link, but I've already seen that article (some years ago). I'm not trying to go beyond 2GB, just want to know my position within a file. I can't use things like Seek() because I'm not using Open.

In text file there is no Row or column ID to indicate where we are. But not willing to say this will b the answer. I want to try more.

It's working just fine, except for one thing. How can I tell where I am in the file? I'm dealing with large files (hundreds of MB) so I like to provide a progress indicator, ........

we cannot show progressbar without knowing Min,CurrentPosition,Max value

Till working on that....

Sep 29 '07 #10

1,445

Expert 1GB

[*]Just thought of another alternative while I was typing. Since I can easily determine the file size, I can just add up the length of each line as I go, plus 2 for the delimiters, to track my progress. Yippee![/list]

YES, Good one, U can get Total Size of the file thru FSO,
and Just get total bytes read till now using the "LenB( )" function,
Convert to kb, and Increment the progress bar accordingly....
Real good option, thanx for that..

Regards
Veena

Sep 29 '07 #11

1,977

1GB

How about My Program?

I hope this will be usefull!

Attached Files

ReadTextFile.zip (6.6 KB, 173 views)

Sep 29 '07 #12

1,445

Expert 1GB

Hi Hari,

Read Killer's previous posts, he dont want to use "ReadAll"..

Sep 29 '07 #13

1,977

1GB

Hi Hari,

Read Killer's previous posts, he dont want to use "ReadAll"..

Yha i replied to that post.

In text file there is no Row or column ID to indicate where we are. But not willing to say this will b the answer. I want to try more.

Without row or column id we cannot set directly to any row or column.
But just gussing.....

Sep 29 '07 #14

8,435

Expert 8TB

I'm on a different computer and don't have access to my code. So I'll throw together a demo function to show the sort of process I'm using. First is the FSO version. The second function shows how I would normally do this sort of thing, using Open and Line Input # statements.

Expand|Select|Wrap|Line Numbers

 Sub ReadFile_FSO_version(FileName As String, PrgBar As ProgressBar)

  ' For simplicity, I'm going to assume the progress bar

  ' has Min = 0, Max = 100.
 
  Dim fso As New FileSystemObject

  Dim fil As File

  Dim str As TextStream

  Dim TotalLines As Long

  Dim OnePercent As Long
 
  Set fil = fso.GetFile(FileName)
 
  ' Step 1 - count the lines in the file.

  Set str = fil.OpenAsTextStream(ForReading)

  With str

    Do Until .AtEndOfStream

      .ReadLine

      TotalLines = TotalLines + 1

    Loop

    .Close

  End With

  OnePercent = TotalLines / 100
 
  ' Step 2 - process the data in the file.

  Set str = fil.OpenAsTextStream(ForReading)

  With str

    Do Until .AtEndOfStream

      .ReadLine

      ' Process the data from this line.
 
      If .Line Mod 500 = 0 Then

        PrgBar.Value = .Line / OnePercent

        DoEvents

      End If

    Loop

    .Close

  End With

  Set fil = Nothing
 
End Sub
 
Sub ReadFile_NonFSO_version(FileName As String, PrgBar As ProgressBar)

  ' For simplicity, I'm going to assume the progress bar

  ' has Min = 0, Max = 100.
 
  Dim OnePercent As Long

  Dim FileSize As Long

  Dim FileNo As Long, LineNo As Long

  Dim Text As String
 
  FileNo = FreeFile

  Open FileName For Input Access Read Shared As #FileNo

  FileSize = LOF(FileNo)

  OnePercent = FileSize / 100
 
  Do Until EOF(FileNo)

    Line Input #FileNo, Text

    LineNo = LineNo + 1
 
    ' Process the data from this line.
 
    If LineNo Mod 500 = 0 Then

      PrgBar.Value = Seek(FileNo) / OnePercent

      DoEvents

    End If
 
  Loop
 
  Close #FileNo
 
End Sub

Sep 30 '07 #15

1,977

1GB

Hi killer42,
Did you saw the zip file in #12, if that is okay then; i am ready to explain!

Oct 1 '07 #16

8,435

Expert 8TB

Did you saw the zip file in #12, if that is okay then; i am ready to explain!

Ok, I've just had a look now.

I see it uses the "ReadAll, Split and Ubound" technique described in this thread. Thanks, it could be a useful technique for getting the count more quickly (I currently read line by line and count them). But it doesn't help in my case, as I want to avoid having to read the file and get the line count.

I think I'll run with the idea that occurred to me while typing my earlier message. That is, get the file size up front by using the old-fashioned FileLen() function, then add up the length of each line as I process them (plus two for the delimiters) to track my position.

Oct 1 '07 #17