FileSearch 1.0l LUA 5.11 [Strict] [API 2]

[Massi]

Hello ...

Code: [Select]

--[[

FileSearch 1.0l LUA 5.11 [Strict] [API 2]

By Mutor 11/03/07

In as much as I despise scripting this, I am truly tired of
seeing requests for it. My meager efforts at educating the masses
with 'why this shouldn't be done' have failed. Hmm...  Go figure.
My will broken, here is a bad file search for the new PtokaX API.
For LUA 5.1x only

System resources be damned!

- Endlessly searches for preset 'illegal' filenames / strings, one every 15 [or more] seconds.
- Sends search strings in random order until all are used, then list is cycled again.
- Sends a message to online ReportNick or operators in Main chat if file is found [once per user].
- Sends status message to status bar to ReportNick or online Operators.
- Runs garbage collection if memory usage is 20% or more that startup memory usage.


+Changes from 1.0 11/04/07
~Fixed search list cycle method
+Added stop timer once all terms have been used.
+Seach is begun again with new connection or MyINFO string.
+Added OnError messages to Report function

+Changes from 1.0b 11/06/07
+Added user search checking/blocking, per profile. Returns fraudulent result.
+Added log to file function.
~Cleaned up timer function a bit.

+Changes from 1.0c 11/22/07
+Added kick option, after much prompting and against my better judgement.  :P
+Added nick exclusion table [protect by nick].
+Added log entry for kick, MaxLog variable [log file size restriction]

+Changes from 1.0d 12/01/07
+Added choice of kick/ban

+Changes from 1.0e 12/05/07
+Added search results pattern table
+Added additional status/debug messages

+Changes from 1.0f 12/25/07
~Changed search mode to active in order to get SR from all users.

+Changes from 1.0g 12/25/07
+Added user' IP to report and log messages. Requested by [NL]Scooby™
+Added option to always repy in private message. Requested by [NL]Scooby™

+Changes from 1.0g 04/13/08
+Added support for TTH searches. Requested by [NL]Scooby™

+Changes from 1.0i 04/13/08
-Removed support for API 1, now API 2 strict

+Changes from 1.0k 10/17/08
+Added passive search string.
~Changed SendToAll to SendToUser.
+Added Passive string sent to activeusers, active string sent to passive users.
+Search string is only sent to users with > 0 share.
+Added option to always use TTH root in fraudulent search results.
]]

--//-- Start Settings --//--

-- Add your 'illegal' files in the Words array, use quotes and separate with comma.
-- Keep this list as short and it's contents as precise as possible.
-- Consider that many triggers may be found in legitimate files
-- ie. rape will be found in "The Grapes Of Wrath" and the title 'Lolita'
-- is an actual film, not a good one mind you, but it is a film.

-- Search the hub for these strings/hashes...
local Words = {
--TTH strings must begin with TTH: ie:
--"TTH:ZDAWKJRHFFEJ7IOXZ2A5HTTHOY36GQLFAQWTM6Q",
"5PLWTH46UI433BS3BMRYEFUYRXCL2WU7UFIHECQ",
"badfile","stealthdc","r@ygold","animalsex","beastiality","lolita",
"preteen","incest","rape ","underage","childsex","childporn"
}
-- In an effort to be more specific on 'illegal' files,
-- Search results for these patterns. There should be one for each item in the Words table.
-- It may well be the same entry in the words table [ie. exact match] else use Reg-Exp
-- ["string"] = {# of warnings, 0 = disable,*action,"reply string"},
-- *Action to take against user 0=none, 1=kick, 2 = ban
local Patts = {
--TTH patterns should be the exact TTH hash root
["ZDAWKJRHFFEJ7IOXZ2A5HTTHOY36GQLFAQWTM6Q"] = {0,1,"***Badfiles are not allowed here."},
["5PLWTH46UI433BS3BMRYEFUYRXCL2WU7UFIHECQ"] = {0,2,"Anti-Piracy trojan files are not allowed here."},
["stealthdc"] = {0,1,"StealthDC is not allowed here."},
["badfile"] = {3,1,"Badfiles are not allowed here."},
["stealthdc"] = {0,1,"StealthDC is not allowed here."},
["r@ygold"] = {0,1,"Underage pornography is not allowed here."},
["animalsex"] = {0,1,"Beastality content is not allowed here."},
["beastiality"] = {0,1,"Beastality content is not allowed here."},
["preteen"] = {0,1,"Underage pornography is not allowed here."},
["underage"] = {0,1,"Underage pornography is not allowed here."},
["childsex"] = {0,1,"Underage pornography is not allowed here."},
["childporn"] = {0,1,"Underage pornography is not allowed here."},
[".*lolita.*(%.png|%.jpg|%.gif|%.bmp|%.avi|%.wmv|%.xvid|%.mov|%.ogg|%.mp(g|eg|^3))"] = {0,1,"Underage pornography is not allowed here."},
[" *rap(e|ed|ing).*(%.avi|%.wmv|%.xvid|%.mov|%.ogg|%.mp(g|eg|^3))"] = {0,1,"Rape content is not allowed here."},
[" *incest.*(%.png|%.jpg|%.gif|%.bmp|%.avi|%.wmv|%.xvid|%.mov|%.ogg|%.mp(g|eg|^3))"] = {0,1,"Incest content is not allowed here."},
}

-- "BotName" [ "" = hub bot ]
local Bot = "[FileSearch]"
-- Admin's nick / chatroom name for status messages, "" = disable
-- If disabled, report will be sent to all online operators.
local ReportNick = "Mutor"
-- Send extended status information to ReportNick or Operators , true/false
local Verbose = false
-- Reporting level 0=disabled, 1=critical errors, 2=extended status, 3=all messages
local ReportLevel = 3
-- Always report in PM?  true/false
local PmOnly = true
-- Seconds between file searches [should be >= 15 seconds]
local Secs = 15
-- Always use TTH root in fraudulent $SR, true/false
local AlwaysTTH = true
-- Action to take against user 0=none, 1=kick, 2 = ban
local Action = 1
-- Number of warns before Action is taken, when Action > 0. [0 = disable]
local Warns = 3
-- Perm. ban level, used ony if Action = 2 [1 = Nick Ban, 2 = IP Ban, 3 = Nick/IP Ban]
local BanLevel = 1
-- Exclude these users from check/kick
local Exc = {
["Mutor"] = true,
["OtherNick"] = true,
}
-- Maximum permissable size of log file [in bytes]
local MaxLog = 5000
-- Set your profiles permissions here.
-- profile_idx, Allowed to search for illegal files? [0=no 1=yes], "Profile Name"
local Profiles = {
[-1] = {false,"Unregistered User"},
[0] = {true,"Master"},
[1] = {true,"Operator"},
[2] = {true,"Vip"},
[3] = {false,"Registered User"},
}

local ReportProfiles = {
[-1] = {false,"Unregistered User"},
[0] = {true,"Master"},
[1] = {true,"Operator"},
[2] = {false,"Vip"},
[3] = {false,"Registered User"},
}
--//-- End Settings --//--

local T,Tm,Used,Nicks,Log,HubIp,HubUdp = {},0,{},{},""
OnStartup = function()
if Bot == "" then Bot = SetMan.GetString(21) else Core.RegBot(Bot,"","",true) end
if not Core.GetHubIP() and not SetMan.GetBool(43) then SetMan.SetBool(43,true) SetMan.Save() end
HubIp,HubUdp = Core.GetHubIP(),SetMan.GetString(4)
if HubIp and HubUdp then Tm = TmrMan.AddTimer(1000 * Secs) end
collectgarbage("collect")
end

OnTimer = function(Id)
if Id and Id == Tm then
local x,z = ChkWrd(),string.rep("\t",12).."is kicking because:"
if x then
local s,msg,t = Words[x],"Searching user shares for: [ "..x.." ]  ",1
local tth = s:find("^TTH%:")
if tth then t = 9 end
for _,usr in ipairs(Core.GetOnlineUsers()) do
if Core.GetUserValue(usr,16) > 0 then
local s = "$Search "..HubIp..":"..HubUdp.." F?T?0?"..t.."?"..s.."|"
if Core.GetUserValue(usr,10) then
s = "$Search Hub:"..Bot.." F?T?0?"..t.."?"..s.."|"
end
Core.SendToUser(usr,s)
end
end
Core.SendToAll("$Search "..HubIp..":"..HubUdp.." F?T?0?"..t.."?"..s.."|")
if ReportLevel > 1 then Report(msg..s.." ...",msg..s.." ..."..z) else Report(nil,msg..s.." ..."..z) end
end
if ChkNicks() > 0 then
local tm = os.date()
for i,v in pairs(Nicks) do
--Nicks[nick] = {sr,v,Warns}
--["badfile"] = {0,1,"Badfiles are not allowed here."},
local Warns,Action,Response,Warned = v[2][1],v[2][2],v[2][3]
if Action > 0 and not Exc[i] then
local file = string.format("%q",v[1])
local rsn,msg,rpt,wmsg = "Illegal file: "..file,"You are being kicked for "..file..
" in your share. Please remove it before you return. "..Response,
i.." with I.P. ˙ was kicked for illegal file: "..file,"You have an illegal file your "..
"share: : "..file..". Please remove it. You have [0] warnings left."
local log = "[Kick][I.P.: ˙ ] User: "..rpt.." - "..tm
local t = Core.GetUser(i)
if t then
if not ChkUsr(t.iProfileNumber) then
rpt = rpt:gsub("˙",t.sIP)
log = log:gsub("˙",t.sIP)
if Action == 2 then
if Warns > 0 then
v[2][1] = (Warns - 1)
if not Warned then Warned = tostring(v[2][1]) end
wmsg = wmsg:gsub("%b[]","["..Warned.."]")
rpt = rpt:gsub("kicked","warned")
log = log:gsub("%[Kick%]","[Warned]")
Core.SendToUser(t,"<"..Bot.."> "..wmsg.."|")
else
msg = msg:gsub("kicked","banned")
rpt = rpt:gsub("kicked","banned")
log = log:gsub("%[Kick%]","[Ban]")
Core.SendToUser(t,"<"..Bot.."> "..msg.."|")
local BanTab = {
[1] = BanMan.BanNick(t.sNick, rsn, Bot), --Nick Ban
[2] = BanMan.BanIP(t.sIP, rsn, Bot, false), -- IP Ban
[3] = BanMan.Ban(t, rsn, Bot, false), -- Nick/IpBan
}
if not BanTab[BanLevel] then
Report("Banning of "..t.sNick.." has failed.")
end
end
else
if Warns > 0 then
v[2][1] = (Warns - 1)
if not Warned then Warned = tostring(v[2][1]) end
wmsg = wmsg:gsub("%b[]","["..Warned.."]")
rpt = rpt:gsub("kicked","warned")
log = log:gsub("%[Kick%]","[Warned]")
Core.SendToUser(t,"<"..Bot.."> "..wmsg.."|")
else
Core.SendToUser(t,"<"..Bot.."> "..msg.."|")
Core.Kick(t,Bot,rsn)
end
end
if ReportLevel >= 1 then Report(rpt) end
Logger(log)
end
end
end
Nicks[i] = nil
end
end
local count = ChkNicks()
if count == 0 and next(Used) and #Used >= #Words then
TmrMan.RemoveTimer(Tm) Tm = nil
if ReportLevel ==3 then Report("Stopping timer...") end
end
end
end

UserConnected = function(user)
if not Tm then
Tm = TmrMan.AddTimer(1000 * Secs)
if ReportLevel == 3 then Report("FileSearch timer has started again.") end
end
math.randomseed(os.clock())
Used = {}
end
OpConnected,RegConnected,MyINFOArrival = UserConnected,UserConnected,UserConnected

Report = function(msg,sb)
if msg and msg ~= "" then
if ReportNick ~= "" then
local rn = ReportNick
local op = Core.GetUser(rn)
if op then
if PmOnly then Core.SendPmToUser(op,Bot,msg.."|") else Core.SendToUser(op,"<"..Bot.."> "..msg.."|") end
if sb then Core.SendToUser(op,"<"..Bot.."> "..sb.."|") end
else
SendToChat(Bot,msg)
end
else
if PmOnly then Core.SendPmToOps(Bot,msg.."|") else Core.SendToOps("<"..Bot.."> "..msg.."|") end
if sb then Core.SendToOps("<"..Bot.."> "..sb.."|") end
end
end
end

OnError = function(msg) if ReportLevel > 0 then Report(msg) end end
ChkUsr = function(i) if Profiles[i] then return Profiles[i][1] else return false end end
ChkUsed = function(x) for a,b in ipairs(Used) do if b == x then return true end end return false end
ChkNicks = function() local x = 0 for i,_ in pairs(Nicks) do x = x + 1 end return x end

ChkWrd = function()
if next(Used) and #Used >= #Words then
Used = {}
math.randomseed(os.clock())
if ReportLevel ==3 then Report("Word list expended...") end
return nil
end
local x = math.random(#Words)
while ChkUsed(x) do x = math.random(#Words) end
table.insert(Used,x)
local M = collectgarbage("count")
local pct = math.floor(((M/Mem) * 100))
if pct > 120 then collectgarbage("collect") end
return x
end

SearchArrival = function(user, data)
local nick = user.sNick
if not Exc[nick] then
if not ChkUsr(user.iProfile) then
local _,_,s = data:find("([^?]+)|$")
if s then
if ReportLevel == 3 then Report(nick..": "..s) end
for i,v in ipairs(Words) do
if s:lower():find(v:lower()) then
local Send,U,B,H,I,P,X
Send,U,B,X = Core.SendToNick,user.sNick,SetMan.GetString(21),true
H,I,P = SetMan.GetString(0),Core.GetHubIP(),SetMan.GetString(4)
local Res = s..string.char(92)..U..", Illegal string "..
"detected, search disabled."..string.rep("\t",20)
Log = Log.."[Search] User: "..U.."\tPattern: "..string.format("%q",i)..
"\tSearch String: "..string.format("%q",s).."\tI.P.\t"..user.sIP.."\tDate: "..
os.date("%B %d, %Y at: %I:%M")..string.sub(string.lower(os.date("%p")),1,1).."\n"
local msg = "*Illegal file search from: "..U..
". Using I.P: "..user.sIP.." Searched For: "..s..".*"
msg = msg:gsub(" ",string.char(160))
local x,z = 1,string.rep("\t",50).."is kicking because:"
if ReportLevel > 1 then Report(msg,msg..z) end
Logger(Log)
if AlwaysTTH then H = "TTH:ZDAWKJRHFFEJ7IOXZ2A5HTTHOY36GQLFAQWTM6Q" end
return Send(U,"$SR "..B.." "..Res.." 0 0/0"..H.." ("..I..":"..P..")"),X
end
end
end
end
end
end

SRArrival = function(user, data)
local nick = user.sNick
if not Exc[nick] then
if not ChkUsr(user.iProfile) then
if nick and not Nicks[nick] then
local c5 = string.char(5)
local _,_,hash = data:find(c5.."TTH%:(%w+) %(")
local _,_,sr = data:find("^$SR %S+ ([^"..c5.."]+)"..c5)
if sr then
if ReportLevel == 3 then Report("Search result from "..nick..": "..sr) end
for i,v in pairs(Patts) do
local match = false
if hash then
if hash:find(i,1,true) then match = true hash = "\tTTH:"..hash end
else
hash = ""
end
if sr:lower():find(i:lower():gsub("[%p%c]","%%%1")) then match = true end
if match then
if ReportLevel > 1 then
Report(nick.." - responded to an illegal file search for: "..
"["..i:gsub("|","&#124;").."] Matching item: "..sr..hash)
end
Nicks[nick] = {sr,v[3]}
T[i] = T[i] + 1
Log = Log.."[File] User: "..nick.."\tPattern: "..string.format("%q",i)..
"\tFile: "..string.format("%q",sr).."\tI.P.\t"..user.sIP.."\tDate: "..
os.date("%B %d, %Y at: %I:%M")..string.sub(string.lower(os.date("%p")),1,1).."\n"
local msg = "*Illegal file result from "..nick..": "..
sr..hash..". Found [ "..T[i].." ] times this session.*"
msg = msg:gsub(" ",string.char(160))
local z = string.rep("\t",50).."is kicking because:"
if ReportLevel > 1 then Report(msg,msg..z) end
Logger(Log)
break
end
end
end
end
end
end
end
UDPSRArrival = SRArrival

ToArrival = function(user,data)
local _,_,to = data:find("^$To: (%S+) From:")
if to and to:lower() == ReportNick:lower() then
if ReportProfiles[user.iProfile] then
local _,_,msg = data:find("%b<> (.+)|$")
if msg then SendToChat(user.sNick,msg) end
else
return Core.SendPmToNick(user.sNick,ReportNick,"Sorry "..user.sNick..", this chat is for "..
"select profiles only. Your message has not been sent. :("),true
end
end
end

SendToChat = function(nick,msg)
local Tab = Core.GetOnlineUsers()
for _,usr in ipairs(Tab) do
if ReportProfiles[usr.iProfile] then
if usr.sNick:lower() ~= nick:lower() then
Core.SendToNick(usr.sNick,"$To: "..usr.sNick.." From: "..Bot..
" $<"..nick.."> " ..msg.."|")
end
end
end
collectgarbage("collect")
end

Logger = function(str)
local f,e = io.open("FileSearch.log")
if f then
local e = f:seek("end")
f:close()
if e > MaxLog then
f,e = io.open("FileSearch.log","w")
f:write("") f:close()
end
else
if ReportLevel > 0 then local err = e:sub(1,-2) Report(err,err) end
end
f,e = io.open("FileSearch.log","a+")
if f then
f:write(str) f:flush() f:close()
else
if ReportLevel > 0 then local err = e:sub(1,-2) Report(err,err) end
end
Log = ""
end
for i,v in pairs(Patts) do T[i] = 0 end
Secs = math.max(Secs,15)
math.randomseed(os.clock())
Mem = collectgarbage("count")

using this script, I realized that maybe there is something that is not working properly ... known because
while running the script does not find these files user co eo words share ... perhaps because the checks are performed in the past? Ce can improve it?


Thanks ... Best regards ...

Maximilian.

[the-master]

do you realy want users checked before they join the hub?
editing the script to your own settings and reportnick would perhaps make a difference...

[Massi]

Hello ...

Maybe I explained evil ... maybe my English is not perfect and I apologize ...

The script works correctly and is set well ... this is not my original settings ...

I know it works because it sends the report to my nick of the checks in pvt ...

But I find that some users share files are not moved in preteen and or discovered by the script ...

Maybe not working properly ... I confirmed?

Thanks... Best regards...

Maximilian.

[Mutor]

You know, this thread 'Help with scripts' is for those seeking help in writing script.
You should be posting in the existing scripts topic. This way all relative info for a
specific script is all in one place and thus easier for user to follow.

What this script does:

• Sends out a search for words on a settable interval: Secs with a default of 15 seconds.
• Upon matching search result, acts per settings: Action  0=none, 1=kick, 2 = ban
• Cycles through the list of search words and stops stop upon completion of list
• Finds all matches that clients send results for, it's just a matter of time
• Uses Lua regular expressions [patterns table] and or TTH strings to be most accurate in detection.
  

What this script does not do:

• Replace operators too lazy to set up their own client to conduct these searches
• Waste all the bandwidth PPK has worked so hard to conserve with recent changes to the hubsoft
• Search for all terms at once
• Have any regard for strings or character not included in the words table

Having said all this, ensure reporting options are set appropriately so you see status messages

[Massi]

Thanks...

Maximilian